simple-thrift-queue

Phillip Pearson
http://www.myelin.co.nz/post/2008/8/4/#200808043

This is a toy in-memory (very much non-durable) queue, with a client
and server in Python and a server in C++ – the results of an
evening’s hacking with Facebook’s Thrift protocol/RPC generator.

On my laptop it handles about 4000 RPCs per second, i.e. if you have
one producer and three consumers, the producer can push about 2000
messages per second, which are fairly evenly spread across the
consumers.

The throughput is almost identical with the C++ server. ‘top’ reports
~80% system time and ‘iftop’ reports ~300kB/s traffic.

Requirements

• Thrift
• Python

Building and running

cd src
make
python py/server.py
python py/timer.py
python py/consumer.py
python py/producer.py

Try starting the server and a few consumers, then a producer.

C++ server

cd src/cpp
make run