Monday, January 18, 2021
  • Setup menu at Appearance » Menus and assign menu to Top Bar Navigation
Advertisement
  • AI Development
    • Artificial Intelligence
    • Machine Learning
    • Neural Networks
    • Learn to Code
  • Data
    • Blockchain
    • Big Data
    • Data Science
  • IT Security
    • Internet Privacy
    • Internet Security
  • Marketing
    • Digital Marketing
    • Marketing Technology
  • Technology Companies
  • Crypto News
No Result
View All Result
NikolaNews
  • AI Development
    • Artificial Intelligence
    • Machine Learning
    • Neural Networks
    • Learn to Code
  • Data
    • Blockchain
    • Big Data
    • Data Science
  • IT Security
    • Internet Privacy
    • Internet Security
  • Marketing
    • Digital Marketing
    • Marketing Technology
  • Technology Companies
  • Crypto News
No Result
View All Result
NikolaNews
No Result
View All Result
Home Neural Networks

Versioning Artificial Intelligence Models with MLflow

January 25, 2019
in Neural Networks
Versioning Artificial Intelligence Models with MLflow
586
SHARES
3.3k
VIEWS
Share on FacebookShare on Twitter

Credit: BecomingHuman

What is a proper way to do it?

As I mentioned before, it’s pretty easy to get MLflow running on your machine, I mean, the local machine. You pip install it and you are almost done. But what if you need it to get in a more, let’s say, production ready way? Well, nothing is closer to production than having a MLflow remote tracking server with either SFTP or S3 storage configure. And to be honest, that’s where we lack a lot of information and code from the existing stories.

You might also like

What Can You Do With Python in 2021? (Python Real Life Applications) | by Doga Ozgon | Dec, 2020

The Why, What, and How of Affective Computing | by Javier Gonzalez | Jan, 2021

Write Your First AI Project in 15 Minutes | by Doga Ozgon | Jan, 2021

Before we dig into the code, let’s have a look at the architecture:

Awesome ASCII art

The whole idea, to mimic a real production environment, is to have the User using the services in a remote fashion. Hence, I built the environment using Docker containers with one container per service.

Although one might say that training models from within a Docker container in a MacBook is not better than training on the MacBook itself, it was done in this way to ease the communication between the services.

The idea behind the diagram above it to have the user running a few command lines and a whole environment is ready to be used, or tested. After cloning the repository, what one has to do is the following:

  • Open a terminal window
  • Type docker-compose up
  • Open a terminal tab
  • Type ./scripts/copy_known_hosts.sh
  • Type ./scripts/create_experiments.sh
  • Got to http://localhost:9000 and create a bucket called ai-models

After that, just go to JupyterLab (http://localhost:8888) and play around with the one existing notebook there.

This gives you a whole environment, from remote tracking server to storage (with two different protocols). Not to mention the JupyterLab playground.

How to get to production from here?

That’s an easy one. If you already have an S3/SFTP compatible storage, just configure the MLflow image to use that storage instead of the one from the example.

If you don’t have a storage, then get one! You cannot use your local disk as storage. However, if you cannot afford the storage money, just use the setup I created and make sure you backup the storage directory into an external disk so you can restore it if you need to.

All in all, do not get locked in because it doesn’t take much to get a proper system running. In a team of five, at least one person should know how things work.

Are you still reading?

Thanks a lot for your time. I hope you have enjoyed it and that it can save you some time and help you to get your models properly versioned. Now, to the code and some more reading, please follow this link: Artificial Intelligence Engineering.

I have some other stories on DL + NLP + AWS that you might want to look at. So, stop reading now, clap and go to the next story. 😉

Don’t forget to give us your 👏 !

Credit: BecomingHuman By: Wilder Rodrigues

Previous Post

This old trojan learns new tricks in its latest banking info and password-stealing campaign

Next Post

Decentralized Machine Learning (DML) Price Tops $0.0030 on Top Exchanges

Related Posts

What Can You Do With Python in 2021? (Python Real Life Applications) | by Doga Ozgon | Dec, 2020
Neural Networks

What Can You Do With Python in 2021? (Python Real Life Applications) | by Doga Ozgon | Dec, 2020

January 16, 2021
The Why, What, and How of Affective Computing | by Javier Gonzalez | Jan, 2021
Neural Networks

The Why, What, and How of Affective Computing | by Javier Gonzalez | Jan, 2021

January 15, 2021
Write Your First AI Project in 15 Minutes | by Doga Ozgon | Jan, 2021
Neural Networks

Write Your First AI Project in 15 Minutes | by Doga Ozgon | Jan, 2021

January 15, 2021
Building a small knowledge graph using NER | by Swayatta Daw | Jan, 2021
Neural Networks

Building a small knowledge graph using NER | by Swayatta Daw | Jan, 2021

January 14, 2021
The story of machine proofs — Part II | by Sharad Sundararajan | Jan, 2021
Neural Networks

The story of machine proofs — Part II | by Sharad Sundararajan | Jan, 2021

January 14, 2021
Next Post
Decentralized Machine Learning Trading 17.8% Lower Over Last 7 Days (DML)

Decentralized Machine Learning (DML) Price Tops $0.0030 on Top Exchanges

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Recommended

Plasticity in Deep Learning: Dynamic Adaptations for AI Self-Driving Cars

Plasticity in Deep Learning: Dynamic Adaptations for AI Self-Driving Cars

January 6, 2019
Microsoft, Google Use Artificial Intelligence to Fight Hackers

Microsoft, Google Use Artificial Intelligence to Fight Hackers

January 6, 2019

Categories

  • Artificial Intelligence
  • Big Data
  • Blockchain
  • Crypto News
  • Data Science
  • Digital Marketing
  • Internet Privacy
  • Internet Security
  • Learn to Code
  • Machine Learning
  • Marketing Technology
  • Neural Networks
  • Technology Companies

Don't miss it

Google is Rethinking its Business – What About You?
Data Science

Google is Rethinking its Business – What About You?

January 18, 2021
Covalent and IBM partnership looks to fashion sustainability through blockchain
Blockchain

Covalent and IBM partnership looks to fashion sustainability through blockchain

January 18, 2021
Get the machine learning for beginners overview bundle for under $20
Machine Learning

Get the machine learning for beginners overview bundle for under $20

January 18, 2021
Singapore tightens cyber defence guidelines for financial services sector
Internet Security

Singapore tightens cyber defence guidelines for financial services sector

January 18, 2021
FairML: Auditing Black-Box Predictive Models
Data Science

FairML: Auditing Black-Box Predictive Models

January 18, 2021
AdaBoost Vs Gradient Boosting: A Comparison
Machine Learning

AdaBoost Vs Gradient Boosting: A Comparison

January 18, 2021
NikolaNews

NikolaNews.com is an online News Portal which aims to share news about blockchain, AI, Big Data, and Data Privacy and more!

What’s New Here?

  • Google is Rethinking its Business – What About You? January 18, 2021
  • Covalent and IBM partnership looks to fashion sustainability through blockchain January 18, 2021
  • Get the machine learning for beginners overview bundle for under $20 January 18, 2021
  • Singapore tightens cyber defence guidelines for financial services sector January 18, 2021

Subscribe to get more!

© 2019 NikolaNews.com - Global Tech Updates

No Result
View All Result
  • AI Development
    • Artificial Intelligence
    • Machine Learning
    • Neural Networks
    • Learn to Code
  • Data
    • Blockchain
    • Big Data
    • Data Science
  • IT Security
    • Internet Privacy
    • Internet Security
  • Marketing
    • Digital Marketing
    • Marketing Technology
  • Technology Companies
  • Crypto News

© 2019 NikolaNews.com - Global Tech Updates