Skip to content

Commit

Permalink
📝 mod docs
Browse files Browse the repository at this point in the history
  • Loading branch information
jmeisele committed Apr 1, 2021
1 parent 4ed18ed commit 856ef26
Show file tree
Hide file tree
Showing 3 changed files with 25 additions and 68 deletions.
41 changes: 8 additions & 33 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -44,54 +44,29 @@ Make sure docker is running and you have [Docker Compose](https://docs.docker.co
password : _admin_

![Grafana](docs/grafana_login.gif)
7. Add the Prometheus data source

URL: ```http://prometheus:9090```

![Prometheus](docs/prometheus.gif)
8. Add the InfluxDB data source

URL: ```http://influxdb:8086```

Basic Auth

User: _ml-ops-admin_

Password: _ml-ops-pwd_

Database: _mlopsdemo_

![InfluxDB](docs/influxdb.gif)

9. Import the MLOps Demo Dashhboard from the Grafana directory in this repo
![MLOps_Dashboard](docs/mlopsdashboard.gif)

10. Create an Alarm Notification channel

URL: ```http://bridge_server:8002/route```

![Alarm_Channel](docs/alarm_channel.gif)
_Both Promethus and InfluxDB data sources have already been provisioned along with an MLOps Demo Dashboard and a Notification Channel._

11. Add the alarm channel to some panels
7. Add the alarm channel to some panels
![Panels](docs/alarms_to_panels.gif)

12. Start the ```send_data.py``` script which sends a POST request every 0.1 seconds
8. Start the ```send_data.py``` script which sends a POST request every 0.1 seconds

13. Open a browser and turn on the Airflow DAG used to retrain our ML model
9. Open a browser and turn on the Airflow DAG used to retrain our ML model

user: _airflow_

password : _airflow_

![Airflow](docs/airflow_login.gif)

14. Lower the alarm threshold to see the Airflow DAG pipeline get triggered
10. Lower the alarm threshold to see the Airflow DAG pipeline get triggered

![Threshold](docs/lower_threshold.gif)

15. Check [MLFlow](http://localhost:5000) after the Airflow DAG has run to see the model artifacts stored using MinIO as the object storage layer.
11. Check [MLFlow](http://localhost:5000) after the Airflow DAG has run to see the model artifacts stored using MinIO as the object storage layer.

16. (Optional) Send a POST request to our model service API endpoint
12. (Optional) Send a POST request to our model service API endpoint
```bash
curl -v -H "Content-Type: application/json" -X POST -d
'{
Expand All @@ -106,7 +81,7 @@ Make sure docker is running and you have [Docker Compose](https://docs.docker.co
}'
http://localhost/model/predict
```
16. (Optional) If you are so bold, you can also simluate production traffic using locust, __but__ keep in mind you have a lot of services running on your local machine, you would never deploy a production ML API on your local machine to handle production traffic.
13. (Optional) If you are so bold, you can also simluate production traffic using locust, __but__ keep in mind you have a lot of services running on your local machine, you would never deploy a production ML API on your local machine to handle production traffic.

## Level 1 Workflow & Platform Architecture
![MLOps](docs/mlops_level1.drawio.svg)
Expand Down
Binary file added docs/kafka.jpeg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
52 changes: 17 additions & 35 deletions docs/ml_api_architecture.drawio.svg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.

0 comments on commit 856ef26

Please sign in to comment.