Large Language Models

All content in this series

Pill

DictBERT: Dictionary Description Knowledge Enhanced Language Model Pre-training via Contrastive Learning

External knowledge can be injected into pre-trained language models (here specifically BERT) by training an additional language model on …

A picture of Michael
Large Language Models

Other series in Advances and fundamentals in ML

Error estimation and model selection

Correct model selection requires careful data handling and attention to iterative or cyclic design / deployment procedures, as are the norm in everyday business applications. Performance estimates must be revised in view of data …

1 item

Diffusion Models

Diffusion models (DM) have become the state of the art for sample quality in generative modelling. They work by sequentially corrupting training data with slowly increasing noise and then learning to reverse the corruption. A look at their …

8 items

Geometric deep learning

Specialized deep learning architectures exploit the intrinsic regularities arising from the underlying structure of the physical world. Geometric deep learning aims to expose these regularities through unified geometric principles. Doing …

3 items

Simulation and AI

From parameter estimation for simulators to full-fledged digital twins, AI promises faster development and reduced modelling effort. The truth is however nuanced and practical applications are not so straightforward as one would like.

6 items
Check all of our work