SciGeeks universe

Tune in to talk about everything data analysis in a cloud-native world. I'm dciangot, your host, and I'm a physicist specialized in software architectures for large scale data analysis.

From machine learning to data visualization, I'll take you through step-by-step tutorials and demonstrations that cover best practices for reproducibility and data management with cutting-edge technologies. Join me and together we'll learn how to conduct transparent, accurate and reproducible scientific research.


SciGeeks universe

After bringing #Kubernetes virtual nodes into #HPC #supercomputers, today a wild #SciGeek appeared into Leonardo supercomputer at Cineca Bologna 😍 spoiler alert: #interLink is running in here already.. somewhere 😁

8 months ago | [YT] | 0

SciGeeks universe

🎉 Ready for the first stream of the year #SciGeeks?
We will look back at the cool stuff we did last year and then we'll introduce the program for the beginning of the #2025!


Montly tech highlights (from INFN exploiting #HPC resources with #interLink to #cloudnative latest tools for #ML ,#AI, and #DataScience with a grain of #DevOps), more SciGeeks podcasts and a "@-io easy to impossible series"!

And... a secret bonus based on my 2025 sub goal! Stay tuned!! 🦾

8 months ago (edited) | [YT] | 1

SciGeeks universe

If you could run a Kubernetes pod on a #EuroHPC cluster batch queue...
Would you use that pod as "runner" to do AI inference for a cloud native platform? We did!

🚨🚨🚨

We are going to dive into this whole tech stack soon.

Meanwhile Enjoy this chat with Luke from ‪@HelixML‬where we deploy a #GenAI development platform on the cloud while running inference on a SLURM #HPC cluster seamlessly through #interLink #kubernetes virtual node!

8 months ago | [YT] | 1

SciGeeks universe

Part 1 is happening tonight!
As soon as the kid goes to sleep we will start:

- setting up #K8s over VMs with Rancher #rke2
- preparing deployments: #minio S3 object storage, #nats for streaming data
- building the #JupyterLab image with all the required software

Remember, I'll be working on building a platform to host the 6th edition of #OpenScience Cloud School! Bring a lot of coffee ☕

#devops #mlops #openscience #datascience #computingschool

9 months ago (edited) | [YT] | 2

SciGeeks universe

Hey SciGeeks! To make up for not being able to join the #KubeconNA folks, I'll have a series of live sessions this week, resuming the cloud computing tutorials:

www.youtube.com/playlist?list...

I'll be working on building a platform to host the 6th edition of #OpenScience Cloud School! Bring a lot of coffee ☕

#kubecCon #cloudComputing #devops #mlops #JupyterNotebooks #docker #kubernetes #gitops

10 months ago | [YT] | 1

SciGeeks universe

This week I'll be in Cracow for Computing in High Energy amd Nuclear Physics (#CHEP2024)! The perfect place for SciGeeks!

How cool is that? We do analyze a lot of data and we have distributed infrastructure and data centers around the world.

I'll try to cover what's new and cool, and what we do in a scientific computing conference. Stay tuned, amd if you are curious, just drop your questions right away!

#HEP #HPC #HTC #ScientificComputing #DevOps #SciGeeks

10 months ago | [YT] | 0

SciGeeks universe

🎉🎉🎉It's time! I'm so happy to let you know that I've been selected as 2024 Dagger Commander! dagger.io/blog/2024-dagger-commanders

If you follow me since a while you might already know, but for all the others here why it's so exciting.

Dagger is a powerful, programmable open source CI/CD engine that runs your pipelines in containers, with reusable pieces called modules. Everything while being reproducible on your laptop with 0 changes needed!

As a Dagger Commander, I’ll be sharing my knowledge, helping others get started, and pushing the boundaries of what’s possible in CI/CD pipelines.

A huge thank you to the ‪@dagger-io‬​ community and team for this unique opportunity and the great support! If you want to jump on board with me on this journey, feel free to reach out or check out our Discord server!!

#cicd #devops #docker #container #DAG #DAGs

11 months ago (edited) | [YT] | 0

SciGeeks universe

🚨🚨🚨
If you are curious about making an e2e test suite for your k8s components with a new approach, you might consider tuning in tomorrow!
🚨🚨🚨

I'll showcase our early experience at INFN building our test pipeline for #interLink. It runs in the same fashion on your laptop and on a github action, and we plan to evaluate it also as a "quick start" tool!🚀🚀

A very promising investigation so far! Kudos to ‪@dagger-io‬ devs!!

‪@interTwin‬ #kubernetes #e2e #ci #devops #dagger

1 year ago | [YT] | 0

SciGeeks universe

It's always nice to be back at #cern especially when you happen to do it in a sunny day - pretty rare for me tbh :)

1 year ago | [YT] | 0

SciGeeks universe

⚠️⚠️⚠️
Need help scheduling the upcoming videos and live.
Here the options in my mind, choose the next one!

Also there are some hidden gems ahead, but won't tell you what yet :)

1 year ago | [YT] | 0