Improving a day in the life of: MLOps Engineer - How ClearML is actually used 2

Improving a day in the life of: MLOps Engineer - How ClearML is actually used 2

Jun 16, 2022

Find the code here: https://github.com/thepycoder/infrastructure_example

ClearML in the real world, without the marketing fluff.

Watch along as we show how ClearML can make the life of an MLOps engineer much easier. Get lots of tips, tricks and inspiration on the use of the queueing system, remote agents, automation like schedulers etc.

===============================================
💻 Get a server:

Get started by using our free tier servers: https://app.clear.ml
OR by hosting you own: https://github.com/allegroai/clearml-server

📄 Documentation on Fundamentals:

Get Started: https://clear.ml/docs/latest/docs/getting_started/ds/ds_first_steps
Pip Package / ClearML SDK: https://clear.ml/docs/latest/docs/clearml_sdk
ClearML Data: https://clear.ml/docs/latest/docs/clearml_data/clearml_data
ClearML Agent: https://clear.ml/docs/latest/docs/clearml_agent
Supported libraries for automagical integration: https://clear.ml/docs/latest/docs/integrations/libraries

✨ Follow us and star us!

Github page: https://github.com/allegroai/clearml
Twitter: https://twitter.com/clearmlapp
Slack Channel: https://join.slack.com/t/allegroai-trains/shared_invite/zt-c0t13pty-aVUZZW1TSSSg2vyIGVPBhg
LinkedIn: https://www.linkedin.com/company/clearml

===============================================

00:00 - Intro

00:54 - Workers & Queues

08:30 - Queue Priority and Aborts

11:28 - Launching a new agent

15:55 - Autoscaler

19:32 - Agents on Kubernetes

20:38 - Enqueueing tasks from code

25:18 - Autoscaler Result

26:20 - Automation

27:04 - Task Scheduler

34:38 - Trigger Scheduler

43:53 - Slack Alerting

45:42 - ClearML Agent on Colab for FREE GPU!

48:47 - Outro