Ian    I ran another Executives at PyData discussion session for leaders at our PyDataLondon conference a couple of weeks back. We had great conversation which dug into a lot of topics. I’ve written up notes on my NotANumber newsletter. If you’re a leader of DS and Data Eng teams, you probably want to...

Ian    I’ve used the Pandas data science toolkit for over a decade and I’ve filed a couple of issues, but I’ve never contributed to the source. At the weekend I got to balance the books a little by making my first commit. With this pull request I fixed the recent request to update the pct change docs

Ian    On November th we saw the most ambitious ever PyData conference PyData Global was a combination of world wide PyData groups putting on a huge event to both build our international community and to leverage the on line only conferences that we need to run during Covid . The conference...

Ian    I’ve had a chance to return to talking about High Performance Python at EuroPython after my first tutorial on this topic back in in Florence. Today I spoke on Making Pandas Fly with a focus on making Pandas run faster. This covered: Categories and RAM saving datatypes to make x...

Ian    I’ve recently switched back from Sourdough yeast to dried packet yeast mix, given a recipe by a colleague thanks Nick . I immediately set to work modifying his recipe well, cutting out steps if we’re honest . The first loaf looked fine but was bland I cut out too much salt. The next was really...

Ian    I gave another iteration of my Making Pandas Fly talk sequence for PyDataAmsterdam recently and received some lovely postcards from attendees as a result. I’ve also had time to list new iterations of my training courses for Higher Performance Python October and Software Engineering for Data...

Ian    I thank the PyDataAmsterdam organisers for another chance to speak on Making Pandas Fly PyDataAmsterdam . This variant of the talk focuses more on: Understanding when categories beat strings and smaller floats beat larger ones What’s happening with NumPy behind the scenes How we can save...

Ian    Over the weekend I hacked on dtype diet a tool for Pandas users that checks their DataFrame to see if smaller datatypes might be applicable. If so they’d offer no data loss and a reduction in RAM, for Categorical data there’s also the possibility of faster calculations. This tool makes no changes...

Ian    So High Performance Python nd ed finally shipped Amazon, Goodreads yay In brief we’ve added notes on how you can be a highly performant programmer , added some more profiling, added Pandas onto NumPy, improved the Compiling to C chapter with more Numba and a new full section on GPUs in...

Ian    Well, mid next week note I guess. I gave another variant of my higher performance Python talk last night for PyDataUK to live streamers, we had some good questions, cheers all. On Friday Micha I heard that the nd edition of our Higher Performance Python book has gone to the printers we’d...