St.L Linux Users Grp ~Local AI LLMs & RAG (Retrieval Augmented Generation) for content
promotion
When
Thursday, Mar 21, 2024
Description: Title: Using Local LLMs and RAG for content promotion
Presenter: Sean Twiehaus
<https://www.google.com/url?q=https%3A%2F%2Fwww.sluug.org%2Fbio%2FSean_Twiehaus&sa=D&ust=1711162500000000&usg=AOvVaw2DAUTlnGXXE-D35jeTvYXT>
SLUUG produces a lot of content, but we are horrible at promoting it. In this presentation
I will show how we could use Open Src Sftwr and AI's Open Src Large Language Models
(LLM) running on our privately owned hardware to promote the content we create with
minimal effort.
If you ask a Large Language Model what the St. Louis Unix Users Group is, it has a good
answer pulled directly from our website. If you ask specific questions about a
presentation that has been given, you quickly realize the limitations. Using Retrieval
Augmented Generation (RAG), we can 'teach' the Large Language Model about our
presentations. Once taught, we can utilize these Large Language Models to generate
summaries, lists of key topics, tweets, YouTube titles, thumbnails, etc.
Recently Stan R. has begun uploading our presentation archives to our Youtube Channel
<https://www.youtube.com/@SluugOrg/featured>. I will demonstrate how we can
'teach' an Open Source LLM about a specific presentation then get it to generate
several titles suitable for the YouTube Video. Then, we will have it generate the video
description. Then we will have it generate a list of tags and key phrases.
Then, we will imagine a program where we submit a talk Title and Abstract into a program,
then all these things are generated automatically, all using Open Source Software and Open
Source Large Language Models running on our private hardware.
If anyone is willing to volunteer to make such a program, please reach out! Volunteers
Needed!
==============
See
https://www.stllinux.org/
<https://www.google.com/url?q=https%3A%2F%2Fwww.stllinux.org%2F&sa=D&ust=1711162500000000&usg=AOvVaw1ctNcOEn8SSJlRWRhuPIew>
for current information. The URL link to this meeting is posted earlier in the day of the
meeting on the above home page. It is the link called "linked here".
ONLINE MEETINGS ONLY until further notice.
ONLINE session will use a remote video meeting service.
HOW TO CONNECT instructions will be on the
https://www.stllinux.org/
<https://www.google.com/url?q=https%3A%2F%2Fwww.stllinux.org%2F&sa=D&ust=1711162500000000&usg=AOvVaw1ctNcOEn8SSJlRWRhuPIew>
web page and our mailing lists. Note that your browser cache may need to be refreshed each
time you check the web page for the instructions.
We will open the remote session at about 6:00 PM, so that you can join early to test
sharing your microphone, screen and video camera.
The STLLINUX meetings are eight days after the SLUUG General meeting; so, usually on the
third or fourth Thursday of each month from 6:30 PM to 9:00 PM.
==========================================
