MLOps Community
timezone
+00:00 GMT
SIGN IN
  • Home
  • Events
  • Content
  • People
  • Messages
  • Channels
  • Help
Sign In
Sign in or Join the community to continue

Orchestrating Spark Jobs with Kubeflow

Posted Jul 14
# Open Source
# Coding Workshop
# Presentation
Share
SPEAKER
Sadik Bakiu
Sadik Bakiu
Sadik Bakiu
Freelance ML Engineer @ Freelance

Sadik is a Freelance ML Engineer focused on creating production-grade ML workflows. Since the early beginning of his career, more than a decade ago, he was fascinated by Data and Information management systems and has been working in this field ever since. Sadik also writes occasionally about technology topics.

+ Read More

Sadik is a Freelance ML Engineer focused on creating production-grade ML workflows. Since the early beginning of his career, more than a decade ago, he was fascinated by Data and Information management systems and has been working in this field ever since. Sadik also writes occasionally about technology topics.

+ Read More
SUMMARY

Apache Spark and Kubernetes have been established as de facto standards for data processing and container orchestration respectively. This talk will cover how these technologies can be integrated under the orchestration of Kubeflow. (Kubeflow has been emerging as a platform to make ML workflows easy to work with and deploy.) All codes are available here: https://github.com/sbakiu/kubeflow-spark/blob/main/kubeflow_pipeline.py

+ Read More

Watch More

1:05:40
Posted Jul 18 | Views 224
# ML Flow
# KubeFlow
# ML Workflow
1:04:18
Posted Mar 04 | Views 152
# Coding Workshop
# Presentation
# ML Orchestration
58:57
Posted Jul 07 | Views 121
# KubeFlow
# ML Engineering
# Kubernetes
See more