About
Blog
Pills
Software
Trainings
Seminar
Jobs
⚲
Search results
Large Language Models
All content in this series
Blog
AutoDev: Exploring Custom LLM-Based Coding Assistance Functions
We explore the potential of custom code assistant functions based on large language models (LLMs). With our open-source software package …
Software
AutoDev: LLM-Based Coding Assistance Functions
AutoDev is a software package for the realisation of coding assistance functions using large language models (LLMs). It covers fine-tuning, …
Pill
Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training
The process of pre-training large language models can incur significant expenses. As these models continue to grow in size, there is an …
Pill
Reasoning Traces as Learning Signal
An important feature of large language models is their ability to provide detailed responses that resemble “thinking step by …
Pill
Direct Preference Optimization
With direct preference optimization (DPO), a language model can be aligned with human preferences without using reinforcement learning, …
Pill
Augmented Language Models: a survey
A survey of recent advances in augmenting (large) language models with new capabilities such as reasoning, tool use, and more. While the …
Pill
DictBERT: Dictionary Description Knowledge Enhanced Language Model Pre-training via Contrastive Learning
External knowledge can be injected into pre-trained language models (here specifically BERT) by training an additional language model on …
Other series in
Advances and fundamentals in ML
Deep Learning on Functional Data
Much of the data we encounter in everyday life is functional in nature. Examples include weather data, outputs from computer simulations, …
1 item
Error estimation and model selection
Correct model selection requires careful data handling and attention to iterative or cyclic design / deployment procedures, as are the norm …
1 item
Diffusion Models
Diffusion models (DM) have become the state of the art for sample quality in generative modelling. They work by sequentially corrupting …
8 items
Geometric deep learning
Specialized deep learning architectures exploit the intrinsic regularities arising from the underlying structure of the physical world. …
3 items
Simulation and AI
From parameter estimation for simulators to full-fledged digital twins, AI promises faster development and reduced modelling effort. The …
7 items
Check all
of our work
