Search results

Lighteval CPU fallback on LUMI

Status: Open.

#96 In OpenEuroLLM/oellm-eval;

· mdocekal opened on Jun 25, 2026

Separate job per task exhausts queue capacity

Status: Open.

#95 In OpenEuroLLM/oellm-eval;

· mdocekal opened on Jun 25, 2026

Create a multilingual eval suite

Status: Open.

#89 In OpenEuroLLM/oellm-eval;

· geoalgo opened on Jun 17, 2026

Please include a note for the workaround regarding lighteval when evaluating tasks with acc_norm

bugSomething isn't workingSomething isn't working

documentationImprovements or additions to documentationImprovements or additions to documentation

Status: Open.

#87 In OpenEuroLLM/oellm-eval;

· namlh201 opened on Jun 11, 2026

Add megatron-lm checkpoint eval support

enhancementNew feature or requestNew feature or request

Status: Open.

Feature

#54 In OpenEuroLLM/oellm-eval;

· swag2198 opened on Mar 30, 2026

scheduling pr follow-ups

Status: Open.

#7 In OpenEuroLLM/oellm-eval;

· timurcarstensen opened on Jul 23, 2025

Update HF_HOME

Status: Open.

#4 In OpenEuroLLM/oellm-eval;

· geoalgo opened on Jul 4, 2025