Forex Data Orchestration

This involves Four Steps in total:

  1. Trading Data Log generates the data log from MT4/5 and saves CSV and HTML file to VPS folder
  2. Automation Script VPS script runs and move all the CSV and HTML file to NextCloud folder
  3. Data is synced automatically to Local Setup and then Transfer_Script_Local sends all the files from NextCloud to DropBox
  4. Files from DropBox is analyzed through Google Colab code and then it generates 3 files: Combined CSV and CandleStick CSV, and PNG file for analysis and then the files are saved back to DropBox

Link to architecture diagram: System Diagram for Forex Data Orchestration

GitHub Source Code:

  •  Trading Log MT4
    • Purpose: Logs the daily MT4 data log and collects +100K balance and equity amount roughly every second
  • Trading Log MT5
    • Purpose: Logs the daily MT5 data log and collects +100K balance and equity amount roughly every second
  • Automation Script
    • Purpose: Transfers all the weekly logs from 5-6 different windows machines into a central folder. The entire process is automated and runs on a schedule. Saves in total +2 hours of manual effort.
  • Trading Logs Data Analysis
    • Purpose: A single python script which does data analysis for over +500K lines of data points and give overall trading performance. It generates the candlestick chart pattern which gives weekly, monthly trading performance.
    • Example of analysis data is given below:

Related Posts