LLMs – Generative AI is not Sci-fi!


Lingua Custodia was delighted to co-host this event with Cosmian, a company specialised in cybersecurity, at Le Village by CA Paris.

What are LLMs?

Gaëtan Caillaut’s presentation for Lingua Custodia focused on Large Language models (LLMs) and aimed to ‘demystify’ the engineering and science behind large language models. He highlighted LLMs are a type of AI program able to recognise and generate text. These models are trained on large sets of data, which allow the models to learn the probability of generating the next word, based on the context of the word or phrase.

What are the limitations of LLMs?

The limitations of LLMs were also discussed. The quality of the text which is generated is very dependent on the underlying data and there is also a risk that these models can misinterpret the context of the words or phrase. A LLM hallucination happens where the model generates text that is irrelevant or inconsistent with the input data.
LLMs are also very expensive to run and complicated to train.

Retrieval Augmented Generation and RLHF for finetuning

He highlighted the benefit of RAG (Retrieval Augmented Generation) which references an external knowledge base to improve the accuracy and reliability of LLMs. RAG helps to enhance LLM capabilities and has the advantage of not requiring particular training.

RLHF (Reinforcement Learning from Human Feedback) is one of most used finetuning approaches. It helps the model by using human feedback to ensure the model is more efficient, logical and helpful.

Lingua Custodia’s Generative AI Multi-Document Analyser

Olivier Debeugny, Lingua Custodia’s CEO then presented the multi-document data extraction technology which uses RAG to optimise the data extraction quality.

Please note that Lingua Custodia now has a new address in Paris, Le Village by CA Paris, at 55 Rue La Boétie, 75008. We are delighted with our new offices and thrilled to be part of this dynamic eco system which prioritises supporting startups and PMEs.

Digital Finance – TQ Accelerator

Lingua Custodia is delighted to be accepted to participate in the Digital Finance program at Tech Quartier, Franfurt.

Lingua Custodia is one of 15 start ups selected to network and connect at Frankfurt financial centre.  The program brings together corporates and startups in the digital finance domain with the goal of driving innovation to create tangible solutions for the finance industry.

The program runs over a 6-week period from 28 May to 11 July 2024.

Our CEO, Olivier Debeugny has just completed the first 2 weeks of this program and has found the experience to be insightful and very investing.  The selected start ups have been encouraged to collaborate on specific finance use cases, with each start up able to share their experience and knowledge of digital AI solutions.

The networking opportunities have also helped Lingua Custodia to meet potential clients and broaden its contacts in Germany.

Olivier Debeugny participated on the discuss panel at the Network Fintech Start Up event on the 6 June, which focused on ‘Open Finance & AI: Shaping the Future’ for digital finance.  Some of the key points which were highlighted during this event were:

AI and productivity

The expectation is that the implementation of AI in the financial domain will help to boost productivity.  So, the priority use cases are for better managing risk and compliance as well as the simplification of decision making and improved forecasting accuracy. AI will also be used for optimising the client experience, though the main focus for financial companies is really productivity gains.

The challenges and risk of AI for finance

There is clear recognition of the regulatory and ethical implications, as well as data security.  The panel underlined the importance of critical thinking when reviewing AI processes.

The future outlook for AI for finance

The future is promising! 

AI should help to reduce the repetitive and low value-added aspects of individual’s roles.  The skills which will be important are adaptability and flexibility, as well as critical thinking skills.  Individuals should embrace new AI technologies while aiming to understand them and being aware of the importance of ethics, diversity and security.