0. 前言

• 官网，Github，官方介绍，官方介绍翻译版

• 其他参考资料

  • 谷歌最新发布数据集：Open Images V6 来了！新增局部叙事标注形式
  • Google更新最大的带注释图像数据集，添加本地化叙述

1. 简介

• 在很多领域，Open Images 都是目前最大的图像数据集。具体领域后文单独介绍。

• 数据量：900万图片

• 目标检测

  • 目前最大的目标检测数据集。
  • bbox数量1600万，600类别，190万图片。
  • 图像非常多样，每张图片平均有8个标注框。

• 实例分割：280万个物体，350类别。

• 视觉关系（visual relationship）

  • 共330万标注，1466种相互关系
  • 所谓视觉关系，有三种
    • 人物、物体与物体相互关系：pairs of objects in particular relations (e.g. “woman playing guitar”, “beer on table”)
    • 物体属性：object properties (e.g. “table is wooden”)
    • 人类行为：human actions (e.g. “woman is jumping”)

• 局部叙事标注（localized narratives）

  • 共67.5万标注结果
  • 即多模态标注，包含对描述对象添加的语音、文本和鼠标轨迹同步信息
  • 类似于 Image Captioning

• 官网可以浏览数据

  • 浏览网址
  • 可以实现：选择标注形式（即上面提到的四种任务）、类别、split（train/val/test）

2. 获取以及标注格式

2.1 数据获取

• 官方下载页面，CVDF Github 连接
• 图片和标注分开下载
• 图片下载（好像不能直接迅雷下载）：
  • 可以通过 aws cli，不太会用。
  • 可以通过Python脚本一张一张下载。
  • 可以获取所有图片的路径，即这里
• 标注下载（可以迅雷）。官网直接下，好像也没啥好多说的。

2.2 标注格式

• BBox标注文件格式：
  • ImageID：
  • Source：标注来源，是手动标（xclick）还是半自动+人工审核（activemil）
  • LabelName
  • Confidence：都是1，没啥用处
  • XMin、XMax、YMin、YMax：normed bbox，取值范围 [0,1]
  • XClick1X,XClick2X,XClick3X,XClick4X,XClick1Y,XClick2Y,XClick3Y,XClick4Y：通过 xclick 方法得到的四个点，即标注的时候不是标注框，而是标注物体四个方向的极限位置。
  • 其他还有几个属性，没啥好说的
    • IsOccluded: Indicates that the object is occluded by another object in the image.
    • IsTruncated: Indicates that the object extends beyond the boundary of the image.
    • IsGroupOf: Indicates that the box spans a group of objects (e.g., a bed of flowers or a crowd of people). We asked annotators to use this tag for cases with more than 5 instances which are heavily occluding each other and are physically touching.
    • IsDepiction: Indicates that the object is a depiction (e.g., a cartoon or drawing of the object, not a real physical instance).
    • IsInside: Indicates a picture taken from the inside of the object (e.g., a car interior or inside of a building)

ImageID,Source,LabelName,Confidence,XMin,XMax,YMin,YMax,IsOccluded,IsTruncated,IsGroupOf,IsDepiction,IsInside,XClick1X,XClick2X,XClick3X,XClick4X,XClick1Y,XClick2Y,XClick3Y,XClick4Y
000002b66c9c498e,xclick,/m/04bcr3,1,0.312500,0.578125,0.351562,0.464063,0,0,0,0,0,0.312500,0.578125,0.385937,0.576562,0.454688,0.364063,0.351562,0.464063
3550e6ef5d44d91a,activemil,/m/0220r2,1,0.022461,0.865234,0.234375,0.986979,1,0,0,0,0,-1.000000,-1.000000,-1.000000,-1.000000,-1.000000,-1.000000,-1.000000,-1.000000

• 视觉关系
  • 本质就是一个三元组（物体/人1、物体/人2、相互关系）
  • ImageID：图像编号
  • LabelName1：第一个物体/人的类别标签
  • XMin1、XMax1、YMin1、YMax1：第一个物体的bbox坐标，normed坐标，即[0,1]之间
  • LabalName2：第二个物体/人的类别标签
  • XMin2、XMax2、YMin2、YMax2：第二个物体的bbox坐标，normed坐标，即[0,1]之间
  • RelationLabel：关系标签，如果是任务属性（如Lay/Is/Sit等），那LabelName1和LabelName2代表的是同一物体/人

ImageID,LabelName1,LabelName2,XMin1,XMax1,YMin1,YMax1,XMin2,XMax2,YMin2,YMax2,RelationLabel
0009fde62ded08a6,/m/0342h,/m/01d380,0.2682927,0.78549093,0.4977778,0.8288889,0.2682927,0.78549093,0.4977778,0.8288889,is
00198353ef684011,/m/01mzpv,/m/04bcr3,0.23779725,0.30162704,0.6500938,0.7335835,0,0.5819775,0.6482176,0.99906194,at
001e341dd7456c72,/m/04yx4,/m/01mzpv,0.07009346,0.2859813,0.2332708,0.5203252,0.14018692,0.31588784,0.32082552,0.48405254,on

• 实例分割：暂时不关心
• ImageIDs
  • 图片的详细信息
  • 包括：image URLs, their OpenImages IDs, the rotation information, titles, authors, and license information

3. 按类别下载图片脚本

• 官方给了下载脚本
  • 脚本链接
  • 大概就是构建一个图片列表文件，然后按照列表下载
  • 需要安装一些依赖：pip install tqdm boto3 botocore requests
  • 然后就可以指定文件列表下载了：python downloader.py $IMAGE_LIST_FILE --download_folder=$DOWNLOAD_FOLDER --num_processes=5
  • 文件列表形式：

train/f9e0434389a1d4dd
train/1a007563ebc18664
test/ea8bfd4e765304db

• 要自己写个脚本，根据bbox类别获取对应的图片
  • 说白了就是读取bbox的标注文件，然后生成就好了
  • 原始脚本要稍微修改一下：如果图片存在并可用，就跳过；如果图片不存在或破损，则下载。
  • 脚本上传到Github了

附录：各种类别介绍

检测标签（600类）

/m/011k07,Tortoise
/m/011q46kg,Container
/m/012074,Magpie
/m/0120dh,Sea turtle
/m/01226z,Football
/m/012n7d,Ambulance
/m/012w5l,Ladder
/m/012xff,Toothbrush
/m/012ysf,Syringe
/m/0130jx,Sink
/m/0138tl,Toy
/m/013y1f,Organ (Musical Instrument)
/m/01432t,Cassette deck
/m/014j1m,Apple
/m/014sv8,Human eye
/m/014trl,Cosmetics
/m/014y4n,Paddle
/m/0152hh,Snowman
/m/01599,Beer
/m/01_5g,Chopsticks
/m/015h_t,Human beard
/m/015p6,Bird
/m/015qbp,Parking meter
/m/015qff,Traffic light
/m/015wgc,Croissant
/m/015x4r,Cucumber
/m/015x5n,Radish
/m/0162_1,Towel
/m/0167gd,Doll
/m/016m2d,Skull
/m/0174k2,Washing machine
/m/0174n1,Glove
/m/0175cv,Tick
/m/0176mf,Belt
/m/017ftj,Sunglasses
/m/018j2,Banjo
/m/018p4k,Cart
/m/018xm,Ball
/m/01940j,Backpack
/m/0199g,Bicycle
/m/019dx1,Home appliance
/m/019h78,Centipede
/m/019jd,Boat
/m/019w40,Surfboard
/m/01b638,Boot
/m/01b7fy,Headphones
/m/01b9xk,Hot dog
/m/01bfm9,Shorts
/m/01_bhs,Fast food
/m/01bjv,Bus
/m/01bl7v,Boy
/m/01bms0,Screwdriver
/m/01bqk0,Bicycle wheel
/m/01btn,Barge
/m/01c648,Laptop
/m/01cmb2,Miniskirt
/m/01d380,Drill (Tool)
/m/01d40f,Dress
/m/01dws,Bear
/m/01dwsz,Waffle
/m/01dwwc,Pancake
/m/01dxs,Brown bear
/m/01dy8n,Woodpecker
/m/01f8m5,Blue jay
/m/01f91_,Pretzel
/m/01fb_0,Bagel
/m/01fdzj,Tower
/m/01fh4r,Teapot
/m/01g317,Person
/m/01g3x7,Bow and arrow
/m/01gkx_,Swimwear
/m/01gllr,Beehive
/m/01gmv2,Brassiere
/m/01h3n,Bee
/m/01h44,Bat (Animal)
/m/01h8tj,Starfish
/m/01hrv5,Popcorn
/m/01j3zr,Burrito
/m/01j4z9,Chainsaw
/m/01j51,Balloon
/m/01j5ks,Wrench
/m/01j61q,Tent
/m/01jfm_,Vehicle registration plate
/m/01jfsr,Lantern
/m/01k6s3,Toaster
/m/01kb5b,Flashlight
/m/01knjb,Billboard
/m/01krhy,Tiara
/m/01lcw4,Limousine
/m/01llwg,Necklace
/m/01lrl,Carnivore
/m/01lsmm,Scissors
/m/01lynh,Stairs
/m/01m2v,Computer keyboard
/m/01m4t,Printer
/m/01mqdt,Traffic sign
/m/01mzpv,Chair
/m/01n4qj,Shirt
/m/01n5jq,Poster
/m/01nkt,Cheese
/m/01nq26,Sock
/m/01pns0,Fire hydrant
/m/01prls,Land vehicle
/m/01r546,Earrings
/m/01rkbr,Tie
/m/01rzcn,Watercraft
/m/01s105,Cabinetry
/m/01s55n,Suitcase
/m/01tcjp,Muffin
/m/01vbnl,Bidet
/m/01ww8y,Snack
/m/01x3jk,Snowmobile
/m/01x3z,Clock
/m/01xgg_,Medical equipment
/m/01xq0k1,Cattle
/m/01xqw,Cello
/m/01xs3r,Jet ski
/m/01x_v,Camel
/m/01xygc,Coat
/m/01xyhv,Suit
/m/01y9k5,Desk
/m/01yrx,Cat
/m/01yx86,Bronze sculpture
/m/01z1kdw,Juice
/m/02068x,Gondola
/m/020jm,Beetle
/m/020kz,Cannon
/m/020lf,Computer mouse
/m/021mn,Cookie
/m/021sj1,Office building
/m/0220r2,Fountain
/m/0242l,Coin
/m/024d2,Calculator
/m/024g6,Cocktail
/m/02522,Computer monitor
/m/025dyy,Box
/m/025fsf,Stapler
/m/025nd,Christmas tree
/m/025rp__,Cowboy hat
/m/0268lbt,Hiking equipment
/m/026qbn5,Studio couch
/m/026t6,Drum
/m/0270h,Dessert
/m/0271qf7,Wine rack
/m/0271t,Drink
/m/027pcv,Zucchini
/m/027rl48,Ladle
/m/0283dt1,Human mouth
/m/0284d,Dairy Product
/m/029b3,Dice
/m/029bxz,Oven
/m/029tx,Dinosaur
/m/02bm9n,Ratchet (Device)
/m/02crq1,Couch
/m/02ctlc,Cricket ball
/m/02cvgx,Winter melon
/m/02d1br,Spatula
/m/02d9qx,Whiteboard
/m/02ddwp,Pencil sharpener
/m/02dgv,Door
/m/02dl1y,Hat
/m/02f9f_,Shower
/m/02fh7f,Eraser
/m/02fq_6,Fedora
/m/02g30s,Guacamole
/m/02gzp,Dagger
/m/02h19r,Scarf
/m/02hj4,Dolphin
/m/02jfl0,Sombrero
/m/02jnhm,Tin can
/m/02jvh9,Mug
/m/02jz0l,Tap
/m/02l8p9,Harbor seal
/m/02lbcq,Stretcher
/m/02mqfb,Can opener
/m/02_n6y,Goggles
/m/02p0tk3,Human body
/m/02p3w7d,Roller skates
/m/02p5f1q,Coffee cup
/m/02pdsw,Cutting board
/m/02pjr4,Blender
/m/02pkr5,Plumbing fixture
/m/02pv19,Stop sign
/m/02rdsp,Office supplies
/m/02rgn06,Volleyball (Ball)
/m/02s195,Vase
/m/02tsc9,Slow cooker
/m/02vkqh8,Wardrobe
/m/02vqfm,Coffee
/m/02vwcm,Whisk
/m/02w3r3,Paper towel
/m/02w3_ws,Personal care
/m/02wbm,Food
/m/02wbtzl,Sun hat
/m/02wg_p,Tree house
/m/02wmf,Flying disc
/m/02wv6h6,Skirt
/m/02wv84t,Gas stove
/m/02x8cch,Salt and pepper shakers
/m/02x984l,Mechanical fan
/m/02xb7qb,Face powder
/m/02xqq,Fax
/m/02xwb,Fruit
/m/02y6n,French fries
/m/02z51p,Nightstand
/m/02zn6n,Barrel
/m/02zt3,Kite
/m/02zvsm,Tart
/m/030610,Treadmill
/m/0306r,Fox
/m/03120,Flag
/m/0319l,French horn
/m/031b6r,Window blind
/m/031n1,Human foot
/m/0323sq,Golf cart
/m/032b3c,Jacket
/m/033cnk,Egg (Food)
/m/033rq4,Street light
/m/0342h,Guitar
/m/034c16,Pillow
/m/035r7c,Human leg
/m/035vxb,Isopod
/m/0388q,Grape
/m/039xj_,Human ear
/m/03bbps,Power plugs and sockets
/m/03bj1,Panda
/m/03bk1,Giraffe
/m/03bt1vf,Woman
/m/03c7gz,Door handle
/m/03d443,Rhinoceros
/m/03dnzn,Bathtub
/m/03fj2,Goldfish
/m/03fp41,Houseplant
/m/03fwl,Goat
/m/03g8mr,Baseball bat
/m/03grzl,Baseball glove
/m/03hj559,Mixing bowl
/m/03hl4l9,Marine invertebrates
/m/03hlz0c,Kitchen utensil
/m/03jbxj,Light switch
/m/03jm5,House
/m/03k3r,Horse
/m/03kt2w,Stationary bicycle
/m/03l9g,Hammer
/m/03ldnb,Ceiling fan
/m/03m3pdh,Sofa bed
/m/03m3vtv,Adhesive tape
/m/03m5k,Harp
/m/03nfch,Sandal
/m/03p3bw,Bicycle helmet
/m/03q5c7,Saucer
/m/03q5t,Harpsichord
/m/03q69,Human hair
/m/03qhv5,Heater
/m/03qjg,Harmonica
/m/03qrc,Hamster
/m/03rszm,Curtain
/m/03ssj5,Bed
/m/03s_tn,Kettle
/m/03tw93,Fireplace
/m/03txqz,Scale
/m/03v5tg,Drinking straw
/m/03vt0,Insect
/m/03wvsk,Hair dryer
/m/03_wxk,Kitchenware
/m/03wym,Indoor rower
/m/03xxp,Invertebrate
/m/03y6mg,Food processor
/m/03__z0,Bookcase
/m/040b_t,Refrigerator
/m/04169hn,Wood-burning stove
/m/0420v5,Punching bag
/m/043nyj,Common fig
/m/0440zs,Cocktail shaker
/m/0449p,Jaguar (Animal)
/m/044r5d,Golf ball
/m/0463sg,Fashion accessory
/m/046dlr,Alarm clock
/m/047j0r,Filing cabinet
/m/047v4b,Artichoke
/m/04bcr3,Table
/m/04brg2,Tableware
/m/04c0y,Kangaroo
/m/04cp_,Koala
/m/04ctx,Knife
/m/04dr76w,Bottle
/m/04f5ws,Bottle opener
/m/04g2r,Lynx
/m/04gth,Lavender (Plant)
/m/04h7h,Lighthouse
/m/04h8sr,Dumbbell
/m/04hgtk,Human head
/m/04kkgm,Bowl
/m/04lvq_,Humidifier
/m/04m6gz,Porch
/m/04m9y,Lizard
/m/04p0qw,Billiard table
/m/04rky,Mammal
/m/04rmv,Mouse
/m/04_sv,Motorcycle
/m/04szw,Musical instrument
/m/04tn4x,Swim cap
/m/04v6l4,Frying pan
/m/04vv5k,Snowplow
/m/04y4h8h,Bathroom cabinet
/m/04ylt,Missile
/m/04yqq2,Bust
/m/04yx4,Man
/m/04z4wx,Waffle iron
/m/04zpv,Milk
/m/04zwwv,Ring binder
/m/050gv4,Plate
/m/050k8,Mobile phone
/m/052lwg6,Baked goods
/m/052sf,Mushroom
/m/05441v,Crutch
/m/054fyh,Pitcher (Container)
/m/054_l,Mirror
/m/054xkw,Personal flotation device
/m/05_5p_0,Table tennis racket
/m/05676x,Pencil case
/m/057cc,Musical keyboard
/m/057p5t,Scoreboard
/m/0584n8,Briefcase
/m/058qzx,Kitchen knife
/m/05bm6,Nail (Construction)
/m/05ctyq,Tennis ball
/m/05gqfk,Plastic bag
/m/05kms,Oboe
/m/05kyg_,Chest of drawers
/m/05n4y,Ostrich
/m/05r5c,Piano
/m/05r655,Girl
/m/05s2s,Plant
/m/05vtc,Potato
/m/05w9t9,Hair spray
/m/05y5lj,Sports equipment
/m/05z55,Pasta
/m/05z6w,Penguin
/m/05zsy,Pumpkin
/m/061_f,Pear
/m/061hd_,Infant bed
/m/0633h,Polar bear
/m/063rgb,Mixer
/m/0642b4,Cupboard
/m/065h6l,Jacuzzi
/m/0663v,Pizza
/m/06_72j,Digital clock
/m/068zj,Pig
/m/06bt6,Reptile
/m/06c54,Rifle
/m/06c7f7,Lipstick
/m/06_fw,Skateboard
/m/06j2d,Raven
/m/06k2mb,High heels
/m/06l9r,Red panda
/m/06m11,Rose
/m/06mf6,Rabbit
/m/06msq,Sculpture
/m/06ncr,Saxophone
/m/06nrc,Shotgun
/m/06nwz,Seafood
/m/06pcq,Submarine sandwich
/m/06__v,Snowboard
/m/06y5r,Sword
/m/06z37_,Picture frame
/m/07030,Sushi
/m/0703r8,Loveseat
/m/071p9,Ski
/m/071qp,Squirrel
/m/073bxn,Tripod
/m/073g6,Stethoscope
/m/074d1,Submarine
/m/0755b,Scorpion
/m/076bq,Segway
/m/076lb9,Training bench
/m/078jl,Snake
/m/078n6m,Coffee table
/m/079cl,Skyscraper
/m/07bgp,Sheep
/m/07c52,Television
/m/07c6l,Trombone
/m/07clx,Tea
/m/07cmd,Tank
/m/07crc,Taco
/m/07cx4,Telephone
/m/07dd4,Torch
/m/07dm6,Tiger
/m/07fbm7,Strawberry
/m/07gql,Trumpet
/m/07j7r,Tree
/m/07j87,Tomato
/m/07jdr,Train
/m/07k1x,Tool
/m/07kng9,Picnic basket
/m/07mcwg,Cooking spray
/m/07mhn,Trousers
/m/07pj7bq,Bowling equipment
/m/07qxg_,Football helmet
/m/07r04,Truck
/m/07v9_z,Measuring cup
/m/07xyvk,Coffeemaker
/m/07y_7,Violin
/m/07yv9,Vehicle
/m/080hkjn,Handbag
/m/080n7g,Paper cutter
/m/081qc,Wine
/m/083kb,Weapon
/m/083wq,Wheel
/m/084hf,Worm
/m/084rd,Wok
/m/084zz,Whale
/m/0898b,Zebra
/m/08dz3q,Auto part
/m/08hvt4,Jug
/m/08ks85,Pizza cutter
/m/08p92x,Cream
/m/08pbxl,Monkey
/m/096mb,Lion
/m/09728,Bread
/m/099ssp,Platter
/m/09b5t,Chicken
/m/09csl,Eagle
/m/09ct_,Helicopter
/m/09d5_,Owl
/m/09ddx,Duck
/m/09dzg,Turtle
/m/09f20,Hippopotamus
/m/09f_2,Crocodile
/m/09g1w,Toilet
/m/09gtd,Toilet paper
/m/09gys,Squid
/m/09j2d,Clothing
/m/09j5n,Footwear
/m/09k_b,Lemon
/m/09kmb,Spider
/m/09kx5,Deer
/m/09ld4,Frog
/m/09qck,Banana
/m/09rvcxw,Rocket
/m/09tvcd,Wine glass
/m/0b3fp9,Countertop
/m/0bh9flk,Tablet computer
/m/0bjyj5,Waste container
/m/0b_rs,Swimming pool
/m/0bt9lr,Dog
/m/0bt_c3,Book
/m/0bwd_0j,Elephant
/m/0by6g,Shark
/m/0c06p,Candle
/m/0c29q,Leopard
/m/0c2jj,Axe
/m/0c3m8g,Hand dryer
/m/0c3mkw,Soap dispenser
/m/0c568,Porcupine
/m/0c9ph5,Flower
/m/0ccs93,Canary
/m/0cd4d,Cheetah
/m/0cdl1,Palm tree
/m/0cdn1,Hamburger
/m/0cffdh,Maple
/m/0cgh4,Building
/m/0ch_cf,Fish
/m/0cjq5,Lobster
/m/0cjs7,Garden Asparagus
/m/0c_jw,Furniture
/m/0cl4p,Hedgehog
/m/0cmf2,Airplane
/m/0cmx8,Spoon
/m/0cn6p,Otter
/m/0cnyhnx,Bull
/m/0_cp5,Oyster
/m/0cqn2,Horizontal bar
/m/0crjs,Convenience store
/m/0ct4f,Bomb
/m/0cvnqh,Bench
/m/0cxn2,Ice cream
/m/0cydv,Caterpillar
/m/0cyf8,Butterfly
/m/0cyfs,Parachute
/m/0cyhj_,Orange
/m/0czz2,Antelope
/m/0d20w4,Beaker
/m/0d_2m,Moths and butterflies
/m/0d4v4,Window
/m/0d4w1,Closet
/m/0d5gx,Castle
/m/0d8zb,Jellyfish
/m/0dbvp,Goose
/m/0dbzx,Mule
/m/0dftk,Swan
/m/0dj6p,Peach
/m/0djtd,Coconut
/m/0dkzw,Seat belt
/m/0dq75,Raccoon
/m/0_dqb,Chisel
/m/0dt3t,Fork
/m/0dtln,Lamp
/m/0dv5r,Camera
/m/0dv77,Squash (Plant)
/m/0dv9c,Racket
/m/0dzct,Human face
/m/0dzf4,Human arm
/m/0f4s2w,Vegetable
/m/0f571,Diaper
/m/0f6nr,Unicycle
/m/0f6wt,Falcon
/m/0f8s22,Chime
/m/0f9_l,Snail
/m/0fbdv,Shellfish
/m/0fbw6,Cabbage
/m/0fj52s,Carrot
/m/0fldg,Mango
/m/0fly7,Jeans
/m/0fm3zh,Flowerpot
/m/0fp6w,Pineapple
/m/0fqfqc,Drawer
/m/0fqt361,Stool
/m/0frqm,Envelope
/m/0fszt,Cake
/m/0ft9s,Dragonfly
/m/0ftb8,Common sunflower
/m/0fx9l,Microwave oven
/m/0fz0h,Honeycomb
/m/0gd2v,Marine mammal
/m/0gd36,Sea lion
/m/0gj37,Ladybug
/m/0gjbg72,Shelf
/m/0gjkl,Watch
/m/0gm28,Candy
/m/0grw1,Salad
/m/0gv1x,Parrot
/m/0gxl3,Handgun
/m/0h23m,Sparrow
/m/0h2r6,Van
/m/0h8jyh6,Grinder
/m/0h8kx63,Spice rack
/m/0h8l4fh,Light bulb
/m/0h8lkj8,Corded phone
/m/0h8mhzd,Sports uniform
/m/0h8my_4,Tennis racket
/m/0h8mzrc,Wall clock
/m/0h8n27j,Serving tray
/m/0h8n5zk,Kitchen & dining room table
/m/0h8n6f9,Dog bed
/m/0h8n6ft,Cake stand
/m/0h8nm9j,Cat furniture
/m/0h8nr_l,Bathroom accessory
/m/0h8nsvg,Facial tissue holder
/m/0h8ntjv,Pressure cooker
/m/0h99cwc,Kitchen appliance
/m/0h9mv,Tire
/m/0hdln,Ruler
/m/0hf58v5,Luggage and bags
/m/0hg7b,Microphone
/m/0hkxq,Broccoli
/m/0hnnb,Umbrella
/m/0hnyx,Pastry
/m/0hqkz,Grapefruit
/m/0j496,Band-aid
/m/0jbk,Animal
/m/0jg57,Bell pepper
/m/0jly1,Turkey
/m/0jqgx,Lily
/m/0jwn_,Pomegranate
/m/0jy4k,Doughnut
/m/0jyfg,Glasses
/m/0k0pj,Human nose
/m/0k1tl,Pen
/m/0_k2,Ant
/m/0k4j,Car
/m/0k5j,Aircraft
/m/0k65p,Human hand
/m/0km7z,Skunk
/m/0kmg4,Teddy bear
/m/0kpqd,Watermelon
/m/0kpt_,Cantaloupe
/m/0ky7b,Dishwasher
/m/0l14j_,Flute
/m/0l3ms,Balance beam
/m/0l515,Sandwich
/m/0ll1f78,Shrimp
/m/0llzx,Sewing machine
/m/0lt4_,Binoculars
/m/0m53l,Rays and skates
/m/0mcx2,Ipod
/m/0mkg,Accordion
/m/0mw_6,Willow
/m/0n28_,Crab
/m/0nl46,Crown
/m/0nybt,Seahorse
/m/0p833,Perfume
/m/0pcr,Alpaca
/m/0pg52,Taxi
/m/0ph39,Canoe
/m/0qjjc,Remote control
/m/0qmmr,Wheelchair
/m/0wdt60w,Rugby ball
/m/0xfy,Armadillo
/m/0xzly,Maracas
/m/0zvk5,Helmet

视觉关系-人物/物体属性（15类）

/m/02gy9n,Transparent
/m/05z87,Plastic
/m/0dnr7,(made of)Textile
/m/04lbp,(made of)Leather
/m/083vt,Wooden
/m/02wzbmj,Stand
/m/083mg,Walk
/m/06h7j,Run
/m/0by3w,Jump
/m/015c4z,Sit
/m/051_dmw,Lay
/m/019nj4,Smile
/m/0463cq4,Cry
/m/015lz1,Sing
/m/01lhf,Talk

视觉关系 - 人物/物体之间相互关系（31类）

at,at
holds,holds
wears,wears
surf,surf
hang,hang
drink,drink
holding_hands,holding hands
on,on
ride,ride
dance,dance
skateboard,skateboard
catch,catch
highfive,highfive
inside_of,inside of
eat,eat
cut,cut
contain,contain
handshake,handshake
kiss,kiss
talk_on_phone,talk on phone
interacts_with,interacts with
under,under
hug,hug
throw,throw
hits,hits
snowboard,snowboard
is,is
kick,kick
ski,ski
plays,plays
read,read

视觉关系 - 人物/物体之间关系三元组（1767类）

• 即人物/物体+人物/物体+动词，内容太多而且不是类别名称，放个链接吧