Repository navigation
Research direction: HPO parameter maps and adaptive parameter switching (GPU and RL notes) #487
luisleo526
started this conversation in
Ideas
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Status: research direction, not planned work. Nothing here is measured yet, and there are no performance claims.
Idea
For a given strategy, use hyperparameter optimisation (HPO) to map how parameters behave under a chosen objective, then switch between a few robust parameter sets during forward execution.
GPU (CUDA) notes
Boundary
The engine stays computation only: the host pushes data and the engine computes results. HPO, the switching model and any GPU work live on the host side as consumers of the engine's results. No engine changes are part of this idea.
Next step, if pursued
A small measurement: GPU screening speed for a simple strategy over roughly 10,000 parameter sets, and an out-of-sample comparison of the switching approach against the best fixed parameter set.
All reactions