simon-arc-lab-web
Website for simon-arc-lab.
Model 289
ARC-AGI training, 24 correct
ARC-AGI evaluation, 6 correct
Model 309
ARC-AGI training, 24 correct
ARC-AGI evaluation, 6 correct
Model 351
ARC-AGI training, 20 correct
ARC-AGI evaluation, 7 correct
Model 364
ARC-AGI training, 20 correct
ARC-AGI evaluation, 7 correct
Model 471
This model solves 1 of the hidden tasks.
ARC-AGI training, 29 correct
ARC-AGI evaluation, 4 correct
Model 538
ARC-AGI training, 27 correct
ARC-AGI evaluation, 7 correct
Model 625
This model solves 1 of the hidden tasks.
ARC-AGI training, 28 correct
ARC-AGI evaluation, 8 correct
2024-oct-16-0105
ARC-AGI training, 20 correct
ARC-AGI evaluation, 4 correct
2024-oct-16-1953
This model solves 1 of the hidden tasks.
ARC-AGI training, 38 correct
ARC-AGI evaluation, 14 correct
2024-oct-17-1318
This model solves 1 of the hidden tasks.
ARC-AGI training, 41 correct
ARC-AGI evaluation, 16 correct
2024-oct-27-2234 - color prediction
TaskColorProfile heuristic about what the output colors may be.
ARC-AGI training
ARC-AGI evaluation
2024-nov-18 - random sampling v1
source code
ARC-AGI training
ARC-AGI evaluation
2024-nov-29 - random sampling v8
source code
ARC-AGI training
ARC-AGI evaluation
2024-dec-15 - measuring bad predictions
Often the score is 100 despite the puzzle not being solved correctly.
source code
ARC-AGI training
2024-dec-22 - measuring bad predictions
Often the score is 100 despite the puzzle not being solved correctly.
source code
ARC-AGI training
2024-dec-29 - decision tree
Untested on the hidden ARC-AGI-1 dataset.
ARC-AGI training, 39 correct
ARC-AGI evaluation, 18 correct