Monitoring a System
627 Views
I’ve been using Python with IbPy, rather than Matlab. The code I post will most likely be in Python going forward. I like it because it’s more natural, ex. default and variable arguments are concise, no semicolons, dictionaries; it’s open source so there are more libraries and it’s free (Matlab requires a “license server” for instances running in parallel, for example); and it’s easier to organize code with better package management, simple classes, and files are more flexible.
Anyway, I like to know what’s going on with my system when I’m away. The system writes out a log of errors, trades, finished processes, etc, and also emails me important events like Trader Workstation shutting down, and executed trades. These go to my Blackberry wherever I am. To send emails from/to a Gmail account…
I’ve been using Python with IbPy, rather than Matlab. The code I post will most likely be in Python going forward. I like it because it’s more natural, ex. default and variable arguments are concise, no semicolons, dictionaries; it’s open source so there are more libraries and it’s free (Matlab requires a “license server” for instances running in parallel, for example); and it’s easier to organize code with better package management, simple classes, and files are more flexible.
Anyway, I like to know what’s going on with my system when I’m away. The system writes out a log of errors, trades, finished processes, etc, and also emails me important events like Trader Workstation shutting down, and executed trades. These go to my Blackberry wherever I am. To send emails from/to a Gmail account, which I like to use because it has a lot of storage and can be searched easily, I had to write a little script (code at the bottom) to add to the Python logging library since Gmail uses a special kind of authentication not supported by the standard library.
Here’s how I use it:
import logginglogging.config.fileConfig(“/yourdirectorystructure/logging.conf“)logging.debug(‘Live trading online’)logging.critical(strategy_name+’ ‘+signal+’ ‘+position_size+’ ‘+etf)
What that says is: load Python’s logging library (which does most of the work for me); then configure it according to my preferences in the file logging.conf; then as an example send a debug-level message ‘Live trading loop starting’; and then a critical-level message with the strategy name, buy/sell signal, position size, and ETF name. These two messages are taken out of context from one of my strategies, so the variables don’t reference anything here. The first is called when I turn on the system, the second is called whenever a trade is executed.
It looks like this in the inbox:
logging.debug(msg) sends a debug(low)-level message to be logged, in my case it prints to a console window and writes to a file. logging.critical(msg) sends a critical(high)-level message, which goes to the console and file, and also gets sent to my email address.
It used to be frustrating to wake up in the morning and see that my system had crashed at some unknown point in the night for some unknown reason, but now I know what’s going on, when it’s happening, and why.
Python’s logging library isn’t documented very well, especially the email handler and file configuration, so I thought sharing these two parts would be useful. Here’s my configuration file, from above (modify it to set the directory where you want to store logs), and the custom Gmail email handler (modify it for your own username/password). The overall logging system works well and adds the minimum amount of superfluous code.
I’m interested in knowing how others have approached the problem of monitoring and logging.
Trending Now
2
IT
33 shares2,463 views
33 shares2,463 views
Is A Big Data A Blessing Or A Curse To The Old Internet?
Andrej Kovacevic - April 17, 20193
Internet of Things
27 shares2,492 views
27 shares2,492 views
Small Devices Will Play a Huge Role in the Future IoT
Rehan Ijaz - April 16, 20194
Big Data
51 shares2,880 views
51 shares2,880 views
5 Innovative Ways Big Data Is Shaping Cities Of The Future
Ryan Kh - April 16, 20195
Analytics
45 shares2,806 views
45 shares2,806 views
How Wix Is Using Predictive Analytics To Deliver Top-Tier Websites
Annie Qureshi - April 16, 20196
Big Data
24 shares2,296 views
24 shares2,296 views
4 Email Tracking Software Tools That Leverage Big Data
Matt James - April 15, 20197
Analytics
37 shares2,100 views
37 shares2,100 views
You must log in to post a comment.