Motif, the top-ranked performer in performance evaluation, gets left out of national team AI... Request for "detailed score disclosure"

The Motif technology company, which placed first in the second AI foundation model company evaluation, has requested the government to disclose detailed evaluation scores and criteria used by the Government. Despite ranking first in the prestigious Intel Intelligence Index global AI performance assessment, the company received the lowest score in expert evaluations, raising doubts about the reasons for its disqualification.

Motif submitted its notice on the 27th, stating that it has officially requested an inquiry into the evaluation results and scoring criteria. In its notice, Motif requested the Ministry of Science and ICT to disclose the following details: the detailed scores and evaluation content for each of the 4 expert teams, the basis for assigning a maximum of 25 points for the global benchmark evaluation, the detailed evaluation standards and criteria for expert evaluations, and the methodology for user evaluations, including whether a blind evaluation was conducted.

Motif's 'Motif3' model scored 47 points in the global AI model evaluation institute AA's Intelligence Index benchmark, higher than its competitors SK Telecom (35 points), LG AI Research Institute (31 points), and UPS. However, it was awarded the lowest score in the comprehensive evaluation on the 18th due to competition from its rivals.

Motif argued that while the benchmark is widely used in the computer engineering industry and academic circles, the scoring method used in this evaluation significantly reduces the difference between the highest and lowest scores. It also challenged the method of converting the benchmark scores to final scores, citing the 16-point difference in the original index score of 47 points for Motif3 and 31 points for LG AI Research Institute, which narrowed down to only 4 points after conversion to a 25-point maximum score.

Motif emphasized that its inquiry is not to argue for its selection in the DPMO but to clarify the purpose of DPMO and find a common improvement direction with other competitors.