Documenting the steps I follow when I think through solutions for a programming problem

Documenting a list of notable data structures and algorithms, that I can work towards mastering

Documenting the factors that goes into the selection of a programming language to write solutions in

A meta-post containing a list of all posts in this series

Images can be represented as a collection of visual "words" or patches, allowing the attention mechanism to be applied to it. This opened the doors for native multimodality capabilities be developed in the form of VLMs

There seems to be an upper cap on LLM performance if compute budget is kept fixed, i.e. capacity of a model. Various studies have found quantified relationships between data size, model size and compute budget which can be used to inform how much resource to use when training an LLM