Presentation on Saturday at 4:25 p.m. to 4:55 p.m. in Room 1170.
Learn how we handle a large amount of data in Django by sharding the data using a developer friendly interface. I'll be talking about what we learned from our initial implementation and sharding style as well as the details we used in implementing a newer system.
First, learn about why we shard, why you probably want to shard, what we originally tried and why it didn't work.
Next, learn about how we re-implemented sharding including the router, unique id generation and all the code that went into the project.
Finally, I'll touch on some of the more advanced topics such as shard re-balancing and dealing with replication lag time.
Joseph is a Python, Django and front-end developer based in Toronto, Canada. He recently graduated with a degree in Computer Science from the University of Toronto. He is a Developer for a Toronto startup called Wave that builds accounting software for small businesses.