vally-eval

CID baeareihwz22vpremgpjlebfymxfmks5233lrqsvyxywgok4mt4gl57vih4
v1.0.0 OASF 1.1.0 Not signed

Security

CID matches content
Yes
Signed
No
0 signature(s)
Trusted (signature verified)
No
pull signatures: pull referrer baeareidh4ev2uz6gb3mnxv7oduosjplvqjsefn7uehunktgfp3yojbi7oy: empty referrer baeareidh4ev2uz6gb3mnxv7oduosjplvqjsefn7uehunktgfp3yojbi7oy
OASF record valid
Yes

Record

Authors
Microsoft
Created
2026-09-07T01:31:11Z
Pulled
1 day ago
Modules
core/language_model/agentskills
Raw OASF record (JSON)
{
  "authors": [
    "Microsoft"
  ],
  "created_at": "2026-09-07T01:31:11Z",
  "description": "Author, validate, and run Vally evaluation suites for agent skills. TRIGGERS: create eval, write eval, add eval, run eval, validate eval, vally eval, eval.yaml, add stimulus, map test to eval, migrate test to eval, eval graders, eval scoring, add eval to CI.",
  "domains": [
    {
      "id": 405,
      "name": "trust_and_safety/risk_management"
    },
    {
      "id": 11107,
      "name": "technology/artificial_intelligence/ai_agents"
    },
    {
      "id": 402,
      "name": "trust_and_safety/content_moderation"
    },
    {
      "id": 2306,
      "name": "insurance/underwriting"
    }
  ],
  "modules": [
    {
      "artifact": {
        "data": "H4sIAAAAAAAA/+xabY/bNhLOZ/2KQVOgm4UlO337sAiKS7dtznebtMhuryiC4ERLY4tZitSRlL3qrz/MkJTltdOkd2jvUMQtsrbMl+G8PPPM0Nd/X15dFW394Hd8LRaLxZeLxYNFeN37+/jzxWdfpGf034PF48Xni8UDWKQFfs9X77ywDxb/9V6j8PFvev5//srzPNOixQvYCqWGHLdCZTW6ysrOS6Mv4KOnvW+MndEAWQuPMxC6Bttr+AdNAZrSCxoMrpceHayNBbFB7cHdSqVcATcvl8+effvy+gIqi8IjT5rBzsrxvajr+I6WDu/SlvuPcb8Z/1sMoo0znZdtr3o3g1Z04NF58CYObeXG0p6HT+lf2FhRo3Xxk6uMlXqzl4VGXy6LjzIlK9QOL+D58iZr0YtaeHGRAQhWzgU8l5U1zqx9BrBF64LqHheLYvFRRkrOHk7UFRWVZdesH5AafIMgfukt5kFn0Kl+IzUIi2DxX720WJM4jdgiSO2RzkQ6p1M58I3wbJPOmrbzDsRGSO08CA1XV8+jOeLhe9LGrkHfoKWNB2hQdfQujhNVZdpOSdfAxogooLAb9OAq1MJK4wq47qvmhCgkMRnWowbhYHv/1DPondSb+IUg2RF6XaNVAz33xih2IdtrzQ/Csrpmc/GTUVLT+8q0WGTZw4fwE7vT0YZZdqT5+0KSI0Ftqr5F7V0BT5U6GO4amhCedFgVWfYS16Q8w9Kb9VpWUuyXCKYhlTQIrmqwFWDW4VOHFR/m+Kvpjq9IhVJvOCJz12HlXp813nfuYj5vk7cVG+mbflVIM+djzze9rNHNjyfPHxWn9EB6PuV27GYk09ooZXak9LVUCEoMpvcF3JDwpJQYKCQgSAfKVMJjDcJD+cRiZ3JrjP9qXrB4HLBlmD2VgpRL8zbGyl+whtUwur+u9yBybxbJjqJqwgA26du2p83c/ElYNK+lJcz7av6EZ+bhw3mQbgZYbIpT06d6ih+EnI9AVBZZ9qNDaFGQ2657FVRGqzvylP0JQ6QUsFyDiNJrxNrBWt753iJPDMaR3k0PPQPpwTWmVzUYuxFa/oLgKBAPpxJyQBmflVBLi5U3dgiBxquOz37rieOq82jIV2xaPhIhkEb7+mxOn9zc9jrnb3P6XHj3iD3/VULrBPAULCHlvD6bhzdu7mwVnTqlgTzN45V2UilQRtQglIIymi+eH+8q7Dxr0DfGRYCZ6GQ+UUoBz8UtqdEi2anrPS95qNGwAIXEySUCADUDBQHhKoKAqnfetIB3WPXe2Cz7vrf3H4JsO4WEGVjDGgUtHOGcDw+1Qac/8eD6rjPWw4B+FiwuHKCwagCPtpWa1TgDNziPbcwD0JparmWVvqssonaN8eDFLac69FUBX6Mj2JjBK7JTLpTKJ7j++mwecWa+M/Z2rczOzU8NLIZWPSIfcJQXTctIMPmefcTNoDJKYeUduyHe0bGwBkqp7B5rDgXSND/yBgTUwjUrI2wNO1yB6LpojwOnHQfNS7Jja7T0xsYAuy8HWHS98q7IsuUaBtNzKtP7JDuY3sYkFQGndwhCDyNc33nU9dRsxo7AKW3aAFYIldGubwOy0dRR0hnvfH7+/Mfrm/Nz3oG+P3ISfSwO57yHQJDjxSYgjNHeGnVqiSy7ObFu7yi5dcjJywtOyj0erbXCRmylsenk95Yp4BoRXnmxyYlIoHWFd6/PimIe/id1uxjLh4Me0U4KhdWwIwYzESVkhej1WBdZ9hW8MB4vGDX1BBTDAdYSHbEdDombGBGs+VoG7yfJWXVA2oYX39+M+i6Z76DHuoycEFZYCfr6MMSQma8L4CPUTgwO1kKqt64yQI1ObjRbiygg4d17khSmhdIBuXhMxFCh9UJqOtcWNR3MFfAdZcI7QUeYMXRNV2l754NbCij90GE5g9JLtPS3Ms6XHHWlsChKdgLHrGaASmhyXqKVBKQCKmMtus7omghBZIQba/qugBsDqBlC7wsQJScNTaSegYiYT5Apagokb1JGwCNCRDKSIqwHtNZYB7sGNadDZMsPsJVGcYCzNCQ2LRI2mUVvpYWlg8q0La24tqblrcqUdg5BvSzLlXBN9hCqXU1McYo3aUqmu5bcIlr1KF1lZVlm2bdHcPFWFGfXnyaGwJhDVOga2j0KtezDDq0UirnT366/fwFm9YYBVhAT6AJhkyfSLQjl9jqnvIMJAsLyDg9iMnjxy/GoUwMR91JqCCSINZFXSlKA21PjC1hqaI3zUAlHuYeAcMfERslbTsR0MjGaKjxtpDswyzKWHXsj0MeLsF2eQ55HJvnxD1c/Plu++Oc3y5eQhyILPub2RzDPNf5WKmM0NGZHHkjoYdxef2pIUk95Q2NM/WsKlBoulydxYOIJB5gQA3QMHtrlchnkT6maFBmDWMtN46nm0jV0/Yrru5SkKMAtbiUS1y9gLG9eVZJP/PqsmFt6iLpCN49Pi7Ye9UB5uq7JaY4r3bcJF9QRIgN20jcptQT4zLLL6Ud3dGB+Dt4KcndjKQVIDYzKq14qn0s9zq3NhEYxQlCZP7K0MGw2RasIqRGIJ2VeYmbTYo/Sb+htEMxOMt6TsEGoMvKwTeFdCa2pe4UR2DbS+egnGneHQtH+B0vy/nEpSqORiZfHIVCO4UPsxmp6xqTZcZ6YJPOkJkZVWoAQJ5ZebKWXGHbkJHsnw4BR9UOW3ZBlQ0MkAKzRauDChsy/lhpz32tMh6qMXstNH3oHTDks1n2FkTfBWhFFReeK6E/RdOT7eeoEnJYl4uUJ7LiYYoecYMcd/GWsqud79KJ9EPJ9IQ1F8V7V5FgWQp5v0a6oBnmSKOH8CSk4p/IoTI3PizfOaEUSZtnPpmd3v0XswPc69T0OtMeesa9Aoy9FO5FxpzrRPvKUuBu0iD7wSrzrsPLBEiMhTsyZSeJRnFDwlHl0wgiyTLvJu044VvG/0PyBdNlJQno/lv5TexE3DXXbxEpB0E8cdMI3xHMsEkOh3koAxE5Y6pOOlCMx7H1TheKi1/c4njw9inZ47zJ+7zYzOqdR2+BiUylZbKQ0dr+jcqzCsRogPCLEeAiXodA7qLey7CdCmNTci6whsPPpuIT1a9NrbugcdqOSxiS6iyzLEz7S2e0Jg5XTIadtWt6TjNPxu+SKmeGZ9H/tV/C0iuzNy7Ug/kWs2YMA540VG+TGaq/93k/GLB3zMafKAlLwMz1LRcqro1J6X0fue4PiVhTtoc05VYdaixL88ZGYBSd2kNiPK9IlwYfXn/Z1ktKlL/+Q+7/FF48XX967//vs08effrj/+yPu/0IxR3Yf64/vRgJMxZ/HjiCJqX3sVX/iRkL2a9x+bCO8o/Sg9mNotdBF1dhqkg4cMRLnZUX3daKq+ran7BmvhAijRgTbyC036GCFnnh06hxaJN4ZeSyYLVFsme6LfrDIV2uOjkFJhFpkJ494VI+H5uNvoiMlnFEzslPSgyC+Q60Z5WWnEH5++vwqdK4fFVGOg/3HPtUkBTCq53wNRolOoy2PGnNxrVP5qyV6xaaoYlGabhkd+r4L/UK6n6IipT62bo2hYYFUMsh0C8O+wgNXA1gMJD0m3lhMEMflgkX4eKckyfuoHIlLxNsxaYOdkxB0BWRA6kr1VIVwnZR6uxNJqT83g/Nz8ljpz8+Tf4ahSlKRQhsYMBoT30rTwSlDNzNfD5Ne1QzKkaHmnPftkJpmTK1q7JQZSvbIwAikBbPTYbUZKUjhXt7Q2hyLWKEN3Rik+zSaM+ntxqdvzAo8tp0SHrPsOfVN4lrkG+LUsEQKJ3V47AONI6SDmiOEe1ukJbZVyetQbfH+jf9Yg14u9y4S7vod65kW7DCVFLHtNhUl/qggOMK0dcBtgVOlLd/C0ukPF6ICFinQO+OcXCksYOnpPmQr6VregeBFAPVWWqOpgp8B3ZULsgxVjHRva4xycLaeku6nZGu4vFqy6cOnb3CLytDBLq+Wj2bkNJo7b2TXsE8Y6PrV+KOK8AuK6MgOei+V9EPCWqKG8YbkAC4PgpiX36FS+a1mR4sEk+g0WYRvvmqz085bFC0dv0JHVXGi5mwbqLGWFbe1k9WybKnBmRanfblWxEJenJgRm8PsjgVcBgVaFI6UHU95cQCv6RcN1B2LCp9Y47AzsL/sEnXo5As1tR1shZVipahlacFhZZFCTox9y1P6p/wSLB5v6td7Sej3By6hMCudQZhqK28MKOp6pyNLvVFIwVIclgAOGkGO1tCN1Zd5QzW27bWXLcFdKz2Qy/C8g7ruHp7EyvuEyrnQ5FziYva+n1LemFU4xdRt+C5gFXHfNRF/UtqouevzDv9hnwz3WezMfIvN3QJPjkYuRyJT/u1kh0pqnO1zZ9qZFgr+Hiuo4zPuqyDnCbnjzATnE+cfnd4ZIEFCEZh+S0Ixrb3UPRfdtPrY4YgIdVLFM+g7aopD+VbEI4YjPXgrNxtqnZ0+R+yoscHY+eUYFWP9ODbpUU909Zb1IqxHs7M1AlpEKxfwk7G3oZ0avDK/NJ1UxudrY/MQD6QjVoyVK6IK6c6PAw/5OmX82dG7ou1DofjnLxQ/vD68Prz+dK9/DwDZcxXhAC4AAA==",
        "digest": "sha256:ab75d08b38389ef253db271a2746609cad1a1d5ef2a45856dd314c91fa2bed60",
        "media_type": "application/agent-skills+gzip",
        "size": 3442
      },
      "data": {
        "artifacts": [
          {
            "artifact_hash": "sha256:5610df9a2d82c926e2137c8240f03fa58be8e8962ff1fe40a63eec803c195f12",
            "path": "references/ci-test.md",
            "type": "reference"
          }
        ],
        "skill_file": "SKILL.md",
        "skill_manifest": {
          "description": "Author, validate, and run Vally evaluation suites for agent skills. TRIGGERS: create eval, write eval, add eval, run eval, validate eval, vally eval, eval.yaml, add stimulus, map test to eval, migrate test to eval, eval graders, eval scoring, add eval to CI.",
          "frontmatter_metadata": {
            "author": "Microsoft",
            "version": "1.0.0"
          },
          "license": "MIT",
          "name": "vally-eval",
          "version": "1.0.0"
        }
      },
      "id": 10302,
      "name": "core/language_model/agentskills"
    }
  ],
  "name": "vally-eval",
  "schema_version": "1.1.0",
  "skills": [
    {
      "id": 71002,
      "name": "ai_ml_engineering/model_evaluation/agent_evaluation"
    },
    {
      "id": 710,
      "name": "ai_ml_engineering/model_evaluation"
    }
  ],
  "version": "1.0.0"
}

Advertisements

GossipSub broadcast

First seen
1 month ago
Last seen
32 seconds ago
Announcements
1,160
Publishers
1
Topics
dir/labels/v1
Every 2 hours, last 3 days
Announcements Publishers
Announcements 30
Nov 14 Nov 15 Nov 16
10 Publishers

DHT add-provider

DHT key
Qmex5pM39BczExrCjhfrJwCSydXmsbT6HQazn1WAVjTBJE
First seen
6 days, 23 hours ago
Last seen
32 seconds ago
Requests
158
Providers
1
Lookups
6
Seekers
6
Last lookup
1 day ago
Every 2 hours, last 3 days
ADD_PROVIDER GET_PROVIDERS Providers
Requests 30
Nov 14 Nov 15 Nov 16
10 Providers

Skills

  • ai_ml_engineering 1
    • model_evaluation 1
      • agent_evaluation

Domains

  • insurance 1
    • underwriting
  • technology 1
    • artificial_intelligence 1
      • ai_agents
  • trust_and_safety 2
    • content_moderation
    • risk_management

Locators

None

Annotations

name
vally-eval
version
1.0.0
oasf-version
1.1.0

GossipSub publishers

DHT providers

github.com/libp2p/go-libp2p Expires in 1 day, 23 hours
Requests
158
First seen
6 days, 23 hours ago
Last seen
32 seconds ago
Connection address
/ip4/3.140.179.223/udp/57133/quic-v1
Listen addresses (3)
  • /ip4/10.0.17.42/tcp/5555
  • /ip4/127.0.0.1/tcp/5555
  • /ip4/3.150.168.105/tcp/5555
Protocols (14)
  • /dir/rpc/1.0.0
  • /floodsub/1.0.0
  • /ipfs/id/1.0.0
  • /ipfs/id/push/1.0.0
  • /ipfs/ping/1.0.0
  • /libp2p/autonat/1.0.0
  • /libp2p/circuit/relay/0.2.0/hop
  • /libp2p/circuit/relay/0.2.0/stop
  • /libp2p/dcutr
  • /meshsub/1.0.0
  • /meshsub/1.1.0
  • /meshsub/1.2.0
  • /meshsub/1.3.0
  • dir/kad/1.0.0

Latest pull attempts

Time Provider Providers found Lookup Connect Pull Total CID Signatures Trusted OASF Result
1 day ago 12D3KooWLf9p3cedc86xGQBaqak6rAFmQk1HxKAK1yh7umHE3amu 1 9,736 ms 0 ms 10,595 ms 20,332 ms 0 OK
2 days, 2 hours ago 12D3KooWLf9p3cedc86xGQBaqak6rAFmQk1HxKAK1yh7umHE3amu 1 6,221 ms 0 ms 12,531 ms 18,752 ms 0 OK
3 days, 4 hours ago 12D3KooWLf9p3cedc86xGQBaqak6rAFmQk1HxKAK1yh7umHE3amu 1 8,960 ms 0 ms 6,965 ms 15,925 ms 0 OK
4 days, 6 hours ago 12D3KooWLf9p3cedc86xGQBaqak6rAFmQk1HxKAK1yh7umHE3amu 1 1,139 ms 0 ms 7,314 ms 8,453 ms 0 OK
5 days, 8 hours ago 12D3KooWLf9p3cedc86xGQBaqak6rAFmQk1HxKAK1yh7umHE3amu 1 6,147 ms 0 ms 6,083 ms 12,231 ms 0 OK
6 days, 10 hours ago 12D3KooWLf9p3cedc86xGQBaqak6rAFmQk1HxKAK1yh7umHE3amu 1 2,674 ms 0 ms 8,639 ms 11,314 ms 1 OK