Some useful Data Science tool I learned from Full Stack Deep Learning

Yanwei Liu
2 min readMar 24, 2021

--

wandb

Tracking ML experiment result (Useful for DL project)

cudf

GPU version of Pandas

pandas-profiling

Check the dataset before you dive into it. (Useful for ML project)

metaflow

Why metaflow

Prefect

Very similar to metaflow

ETL with Prefect

MLFlow

  • Tracking experiments to record and compare parameters and results (MLflow Tracking).
  • Packaging ML code in a reusable, reproducible form in order to share with other data scientists or transfer to production (MLflow Projects).
  • Managing and deploying models from a variety of ML libraries to a variety of model serving and inference platforms (MLflow Models).
  • Providing a central model store to collaboratively manage the full lifecycle of an MLflow Model, including model versioning, stage transitions, and annotations (MLflow Model Registry).

FEAST

Feast (Feature Store) is an operational data system for managing and serving machine learning features to models in production.

Seldon

An open source platform to deploy your machine learning models on Kubernetes at massive scale. Seldon core converts your ML models (Tensorflow, Pytorch, H2o, etc.) or language wrappers (Python, Java, etc.) into production REST/GRPC microservices.

--

--

Responses (1)