Monitoring a System
546 Views
I’ve been using Python with IbPy, rather than Matlab. The code I post will most likely be in Python going forward. I like it because it’s more natural, ex. default and variable arguments are concise, no semicolons, dictionaries; it’s open source so there are more libraries and it’s free (Matlab requires a “license server” for instances running in parallel, for example); and it’s easier to organize code with better package management, simple classes, and files are more flexible.
Anyway, I like to know what’s going on with my system when I’m away. The system writes out a log of errors, trades, finished processes, etc, and also emails me important events like Trader Workstation shutting down, and executed trades. These go to my Blackberry wherever I am. To send emails from/to a Gmail account…
I’ve been using Python with IbPy, rather than Matlab. The code I post will most likely be in Python going forward. I like it because it’s more natural, ex. default and variable arguments are concise, no semicolons, dictionaries; it’s open source so there are more libraries and it’s free (Matlab requires a “license server” for instances running in parallel, for example); and it’s easier to organize code with better package management, simple classes, and files are more flexible.
Anyway, I like to know what’s going on with my system when I’m away. The system writes out a log of errors, trades, finished processes, etc, and also emails me important events like Trader Workstation shutting down, and executed trades. These go to my Blackberry wherever I am. To send emails from/to a Gmail account, which I like to use because it has a lot of storage and can be searched easily, I had to write a little script (code at the bottom) to add to the Python logging library since Gmail uses a special kind of authentication not supported by the standard library.
Here’s how I use it:
import logginglogging.config.fileConfig(“/yourdirectorystructure/logging.conf“)logging.debug(‘Live trading online’)logging.critical(strategy_name+’ ‘+signal+’ ‘+position_size+’ ‘+etf)
What that says is: load Python’s logging library (which does most of the work for me); then configure it according to my preferences in the file logging.conf; then as an example send a debug-level message ‘Live trading loop starting’; and then a critical-level message with the strategy name, buy/sell signal, position size, and ETF name. These two messages are taken out of context from one of my strategies, so the variables don’t reference anything here. The first is called when I turn on the system, the second is called whenever a trade is executed.
It looks like this in the inbox:
logging.debug(msg) sends a debug(low)-level message to be logged, in my case it prints to a console window and writes to a file. logging.critical(msg) sends a critical(high)-level message, which goes to the console and file, and also gets sent to my email address.
It used to be frustrating to wake up in the morning and see that my system had crashed at some unknown point in the night for some unknown reason, but now I know what’s going on, when it’s happening, and why.
Python’s logging library isn’t documented very well, especially the email handler and file configuration, so I thought sharing these two parts would be useful. Here’s my configuration file, from above (modify it to set the directory where you want to store logs), and the custom Gmail email handler (modify it for your own username/password). The overall logging system works well and adds the minimum amount of superfluous code.
I’m interested in knowing how others have approached the problem of monitoring and logging.
Trending Now
1
Analytics
44 shares2,668 views
44 shares2,668 views
How Virtual Assistants Use Data Analytics To Save Clients Money
Diana Hope - January 12, 20192
Artificial Intelligence
77 shares2,830 views
77 shares2,830 views
Here’s Why 2019 Will Bring Debates About Ethics of Artificial Intelligence
Andrej Kovacevic - January 12, 20193
Artificial Intelligence
93 shares3,435 views
93 shares3,435 views
Artificial Intelligence Chatbots Could Make Your Doctors Obsolete
Ryan Kade - January 12, 20194
Big Data
63 shares2,750 views
63 shares2,750 views
6 Ways Big Data Can Improve eCommerce For Your Business
Sean Mallon - January 11, 20195
Big Data
1,790 views
1,790 views
Is Your Data At Risk? Here’s How To Protect Your Information Online
Rehan Ijaz - January 11, 20196
Big Data
51 shares2,513 views
51 shares2,513 views
5 Genius App Data Monetization Strategies That Can Make You Bank
Annie Qureshi - January 10, 20197
Big Data
21 shares1,907 views
21 shares1,907 views
You must log in to post a comment.