MLOps Community
+00:00 GMT
Sign in or Join the community to continue

The State of Open Source AI: Deployment Engines, Licences, & Hardware

Posted Nov 01, 2023 | Views 376
# Open Source AI
# LLMs
# Prem AI
Share
SPEAKERS
Casper  da Costa-Luis
Casper  da Costa-Luis
Casper da Costa-Luis
Tech Lead @ Prem AI

Casper has been contributing to open source since before deep learning existed. In addition to 10+ years of industry experience (at both massive and tiny companies), he has also taught Python/C++/CUDA for ML at all the top universities in London, and is currently building democratic & distributed AI solutions at Prem.

+ Read More

Casper has been contributing to open source since before deep learning existed. In addition to 10+ years of industry experience (at both massive and tiny companies), he has also taught Python/C++/CUDA for ML at all the top universities in London, and is currently building democratic & distributed AI solutions at Prem.

+ Read More
Adam Becker
Adam Becker
Adam Becker
IRL @ MLOps Community

I'm a tech entrepreneur and I spent the last decade founding companies that drive societal change.

I am now building Deep Matter, a startup still in stealth mode...

I was most recently building Telepath, the world's most developer-friendly machine learning platform. Throughout my previous projects, I had learned that building machine learning powered applications is hard - especially hard when you don't have a background in data science. I believe that this is choking innovation, especially in industries that can't support large data teams.

For example, I previously co-founded Call Time AI, where we used Artificial Intelligence to assemble and study the largest database of political contributions. The company powered progressive campaigns from school board to the Presidency. As of October, 2020, we helped Democrats raise tens of millions of dollars. In April of 2021, we sold Call Time to Political Data Inc.. Our success, in large part, is due to our ability to productionize machine learning.

I believe that knowledge is unbounded, and that everything that is not forbidden by laws of nature is achievable, given the right knowledge. This holds immense promise for the future of intelligence and therefore for the future of well-being. I believe that the process of mining knowledge should be done honestly and responsibly, and that wielding it should be done with care. I co-founded Telepath to give more tools to more people to access more knowledge.

I'm fascinated by the relationship between technology, science and history. I graduated from UC Berkeley with degrees in Astrophysics and Classics and have published several papers on those topics. I was previously a researcher at the Getty Villa where I wrote about Ancient Greek math and at the Weizmann Institute, where I researched supernovae.

I currently live in New York City. I enjoy advising startups, thinking about how they can make for an excellent vehicle for addressing the Israeli-Palestinian conflict, and hearing from random folks who stumble on my LinkedIn profile. Reach out, friend!

+ Read More

I'm a tech entrepreneur and I spent the last decade founding companies that drive societal change.

I am now building Deep Matter, a startup still in stealth mode...

I was most recently building Telepath, the world's most developer-friendly machine learning platform. Throughout my previous projects, I had learned that building machine learning powered applications is hard - especially hard when you don't have a background in data science. I believe that this is choking innovation, especially in industries that can't support large data teams.

For example, I previously co-founded Call Time AI, where we used Artificial Intelligence to assemble and study the largest database of political contributions. The company powered progressive campaigns from school board to the Presidency. As of October, 2020, we helped Democrats raise tens of millions of dollars. In April of 2021, we sold Call Time to Political Data Inc.. Our success, in large part, is due to our ability to productionize machine learning.

I believe that knowledge is unbounded, and that everything that is not forbidden by laws of nature is achievable, given the right knowledge. This holds immense promise for the future of intelligence and therefore for the future of well-being. I believe that the process of mining knowledge should be done honestly and responsibly, and that wielding it should be done with care. I co-founded Telepath to give more tools to more people to access more knowledge.

I'm fascinated by the relationship between technology, science and history. I graduated from UC Berkeley with degrees in Astrophysics and Classics and have published several papers on those topics. I was previously a researcher at the Getty Villa where I wrote about Ancient Greek math and at the Weizmann Institute, where I researched supernovae.

I currently live in New York City. I enjoy advising startups, thinking about how they can make for an excellent vehicle for addressing the Israeli-Palestinian conflict, and hearing from random folks who stumble on my LinkedIn profile. Reach out, friend!

+ Read More
SUMMARY

Following the LLMs in Production survey results, we picked the 3 hottest topics to bring some clarity in the current fast-paced mess of Open Source innovation: deployment (starting & maintaining a project is an ongoing unsolved problem) licenses (recently "solved"/permissive for a lot of good architectures, but will remain a mess for data for years) hardware (cost-vs-capability ratio is decreasing, but far more importantly, software portability is finally actually being solved!) Find out what, why, and how in this talk.

+ Read More

Watch More

57:42
Posted Apr 23, 2023 | Views 5.8K
# Spark
# Open Source
# Databricks
56:21
Posted Feb 02, 2024 | Views 780
# GenAI Buy
# Build
# Commercial
# Open Source
# QuantumBlack
34:57
Posted Jun 20, 2023 | Views 523
# LLM in Production
# Scalable Evaluation
# Anyscale.com
# Redis.io
# Gantry.io
# Predibase.com
# Humanloop.com
# Zilliz.com
# Arize.com
# Nvidia.com
# TrueFoundry.com
# Premai.io
# Continual.ai
# Argilla.io
# Genesiscloud.com
# Rungalileo.io