
been trying to teach a machine to watch parkour since march. still not sure it can actually understand it i do parkour and i like messing around with ml, so the idea: film a trick on my phone, have it tell me what i did. which trick, how many flips, how many twists it turned into a whole stack. one model for my joints frame by frame, one that rebuilds my body in 3d, some physics to split the rotations, llms to deal with trick names thought 3d would be the easy part. it's where it broke first. those models learned from people walking and sitting, never anyone flipping. on a trick with two and a half turns, one of them counted almost four then names. ~2,700 trick names and even traceurs don't agree, "hyper" means 4 different things depending on who you ask. ended up writing my own code that describes a trick by physics only: axis, direction, turns the thing that bugs me: it can count the turns in a flip, but what i see in a good run is someone reading a wall and picking a line. not sure that's ever measurable super early. most fun side project i have right now




