Less known packaging features and tricks

You’ve been making packages for a while now. Everything works almost fine, however, lots of new features and tools have been developed recently. Some are really obscure. And there’s a chance they can save you time and help you avoid packaging-induced-pain. I’m willing to bet couple of beers you haven’t seen these features and/or tools before.

This talk is going to show you:

• Patterns and tricks you can use in your setup.py.
• Obscure pip/setuptools/virtualenv/python features you can use to improve your packaging experience (be it as a user of packages or a package author).
• Fledgeling alternative tools.

Details

Distributed Workflows with Flowy

This presentation introduces Flowy, a library for building and running distributed, asynchronous workflows built on top of different backends (such as Amazon’s SWF). Flowy deals away with the spaghetti code that often crops up from orchestrating complex workflows. It is ideal for applications that do multi-phased batch processing, media encoding, long-running tasks, and/or background processing.

We’ll start by discussing Flowy’s unique execution model and see how different execution topologies can be implemented on top of it. During the talk we’ll run and visualize workflows using a local backend. We’ll then take a look at what it takes to scale beyond a single machine by using an external service like SWF.

Details