Monitoring a System
483 Views
I’ve been using Python with IbPy, rather than Matlab. The code I post will most likely be in Python going forward. I like it because it’s more natural, ex. default and variable arguments are concise, no semicolons, dictionaries; it’s open source so there are more libraries and it’s free (Matlab requires a “license server” for instances running in parallel, for example); and it’s easier to organize code with better package management, simple classes, and files are more flexible.
Anyway, I like to know what’s going on with my system when I’m away. The system writes out a log of errors, trades, finished processes, etc, and also emails me important events like Trader Workstation shutting down, and executed trades. These go to my Blackberry wherever I am. To send emails from/to a Gmail account…
I’ve been using Python with IbPy, rather than Matlab. The code I post will most likely be in Python going forward. I like it because it’s more natural, ex. default and variable arguments are concise, no semicolons, dictionaries; it’s open source so there are more libraries and it’s free (Matlab requires a “license server” for instances running in parallel, for example); and it’s easier to organize code with better package management, simple classes, and files are more flexible.
Anyway, I like to know what’s going on with my system when I’m away. The system writes out a log of errors, trades, finished processes, etc, and also emails me important events like Trader Workstation shutting down, and executed trades. These go to my Blackberry wherever I am. To send emails from/to a Gmail account, which I like to use because it has a lot of storage and can be searched easily, I had to write a little script (code at the bottom) to add to the Python logging library since Gmail uses a special kind of authentication not supported by the standard library.
Here’s how I use it:
import logginglogging.config.fileConfig(“/yourdirectorystructure/logging.conf“)logging.debug(‘Live trading online’)logging.critical(strategy_name+’ ‘+signal+’ ‘+position_size+’ ‘+etf)
What that says is: load Python’s logging library (which does most of the work for me); then configure it according to my preferences in the file logging.conf; then as an example send a debug-level message ‘Live trading loop starting’; and then a critical-level message with the strategy name, buy/sell signal, position size, and ETF name. These two messages are taken out of context from one of my strategies, so the variables don’t reference anything here. The first is called when I turn on the system, the second is called whenever a trade is executed.
It looks like this in the inbox:
logging.debug(msg) sends a debug(low)-level message to be logged, in my case it prints to a console window and writes to a file. logging.critical(msg) sends a critical(high)-level message, which goes to the console and file, and also gets sent to my email address.
It used to be frustrating to wake up in the morning and see that my system had crashed at some unknown point in the night for some unknown reason, but now I know what’s going on, when it’s happening, and why.
Python’s logging library isn’t documented very well, especially the email handler and file configuration, so I thought sharing these two parts would be useful. Here’s my configuration file, from above (modify it to set the directory where you want to store logs), and the custom Gmail email handler (modify it for your own username/password). The overall logging system works well and adds the minimum amount of superfluous code.
I’m interested in knowing how others have approached the problem of monitoring and logging.
Trending Now
1
Machine Learning
2,617 views
2,617 views
Savvy Entrepreneurs Are Using Machine Learning to Streamline Logo Design
Rehan Ijaz - November 1, 20182
Big Data
51 shares2,763 views
51 shares2,763 views
Will Big Data Change The Future Of Franchises Forever?
Sean Mallon - November 1, 20183
Blockchain
69 shares3,383 views
69 shares3,383 views
Blockchain And The Future Of Electronic Medical Records
Andrej Kovacevic - October 29, 20184
Internet of Things
73 shares3,634 views
73 shares3,634 views
IoT Is The Most Important Development Of The 21st Century
Sean Mallon - October 29, 20185
Big Data
33 shares3,597 views
33 shares3,597 views
5 Ways Big Data Is Impacting The Self-Storage Industry
Diana Hope - October 26, 20186
Big Data
80 shares3,585 views
80 shares3,585 views
How Big Data Is Helping To Lower Medical Liability Risks
Andrej Kovacevic - October 25, 20187
Artificial Intelligence
97 shares3,809 views
97 shares3,809 views
You must log in to post a comment.