MODEL RESULTVeo 3(Qwen 重审)
Google Veo 3 official public reference videos; independent judge Qwen/Qwen3-VL-8B-Instruct@0c351dd01ed87e9c1b53cbc748cba10e6187ff3b
41YES / 62
21NO / 62
completedload statusOfficial Veo 3 public reference video; no new video generation. Independent judge: Qwen3-VL-8B-Instruct on CUDA; calibration gate=True.
#01
Edge detection
YES
Prompt 与自动判定依据
All edges in this image become more salient by transforming into black outlines. Then, all objects fade away, with just the edges remaining on a white background. Static camera perspective, no zoom or pan.
CUDA judge:The video correctly shows edges becoming black outlines and objects fading to leave only edges on a white background, with no camera motion.
作者参考视频
#02
Segmentation
NO
Prompt 与自动判定依据
Create an animation of instance segmentation being performed on this photograph: each distinct
entity is overlaid in a different flat color.
Scene:
• The animation starts from the provided, unaltered photograph.
• The scene in the photograph is static and doesn’t move.
• First, the background fades to green.
• Then, the first entity is covered by a flat color, perfectly preserving its silhouette.
• Then the second entity, too, is covered by a different flat color, perfectly preserving its
silhouette.
• One by one, each entity is covered by a different flat color.
• Finally, all entities are covered with different colors.
Camera:
• Static shot without camera movement.
• No pan.
• No rotation.
• No zoom.
• No glitches or artifacts.
CUDA judge:The video does not show any instance segmentation; entities are not covered with flat colors, and the background does not fade to green as required.
作者参考视频
#03
Keypoint localization
NO
Prompt 与自动判定依据
Add a bright blue dot at the tip of the branch on which the macaw is sitting. The macaw's eye turns bright red. Everything else turns pitch black. Static camera perspective, no zoom or pan.
CUDA judge:The camera pans away from the macaw in later frames, violating the static camera constraint.
作者参考视频
#04
Super-resolution
YES
Prompt 与自动判定依据
Perform superresolution on this image. Static camera perspective, no zoom or pan.
CUDA judge:The image is visibly super-resolved to high detail with no camera motion.
作者参考视频
#05
Blind deblurring
YES
Prompt 与自动判定依据
Unblur image including background. Static camera perspective, no zoom or pan.
CUDA judge:The image progressively sharpens from blur to clear, maintaining static camera perspective without zoom or pan.
作者参考视频
#06
Blind denoising
YES
Prompt 与自动判定依据
Remove the noise from this image. Static camera perspective, no zoom or pan.
CUDA judge:The noise is visibly removed across frames while maintaining static camera perspective.
作者参考视频
#07
Low-light enhancement
NO
Prompt 与自动判定依据
Fully restore the light in this image. Static camera perspective, no zoom or pan.
CUDA judge:camera pans left and zooms in
作者参考视频
#08
Conjunctive search / binding problem
YES
Prompt 与自动判定依据
The blue ball instantly begins to glow. Static camera perspective, no zoom no pan no movement no dolly no rotation.
CUDA judge:The blue ball glows instantly and remains glowing across all frames with no camera motion.
作者参考视频
#09
Dalmatian illusion understanding
YES
Prompt 与自动判定依据
Static camera perspective.
CUDA judge:The Dalmatian illusion is consistently visible and the camera remains static throughout the sequence.
作者参考视频
#10
Shape cue-conflict understanding
YES
Prompt 与自动判定依据
Transform the animal in this image into a sketch of the animal surrounded by its family.
CUDA judge:The video shows the animal transforming into a sketch and then adding family members as required.
作者参考视频
#11
Rorschach blot interpretation
YES
Prompt 与自动判定依据
The patterns transform into objects.
CUDA judge:The Rorschach blot patterns visibly and sequentially transform into distinct, recognizable objects across the frames.
作者参考视频
#12
Material properties (flammability)
YES
Prompt 与自动判定依据
The bunsen burner at the bottom turns on. Sped up time lapse. Static camera, no pan, no zoom, no dolly.
CUDA judge:The bunsen burner ignites, paper burns visibly, and camera remains static as required.
作者参考视频
#13
Rigid body transform
YES
Prompt 与自动判定依据
A person picks up the vase and puts it back on the table in a sideways orientation. Static camera, no pan, no zoom, no dolly.
CUDA judge:The vase is visibly picked up, rotated sideways, and placed back on the table with no camera motion.
作者参考视频
#14
Soft body transform
YES
Prompt 与自动判定依据
A person drapes a thin silk scarf over the vase. Static camera, no pan, no zoom, no dolly.
CUDA judge:The scarf is visibly draped over the vase in all frames, camera remains static, and no motion violations occur.
作者参考视频
#15
Gravity (earth)
NO
Prompt 与自动判定依据
The objects fall due to gravity. Static camera, no pan, no zoom, no dolly.
CUDA judge:The feather and bowling ball are not falling; they are floating or moving upward, violating gravity.
作者参考视频
#16
Gravity (moon)
NO
Prompt 与自动判定依据
The objects fall down on the moon due to gravity. Static camera, no pan, no zoom, no dolly.
CUDA judge:Neither the feather nor the bowling ball show any downward motion or falling; they remain suspended in place.
作者参考视频
#17
Buoyancy (bottle cap)
YES
Prompt 与自动判定依据
The hand lets go of the object. Static camera, no pan, no zoom, no dolly.
CUDA judge:Hand releases cap, cap floats, camera remains static throughout.
作者参考视频
#18
Buoyancy (rock)
YES
Prompt 与自动判定依据
The hand lets go of the object. Static camera, no pan, no zoom, no dolly.
CUDA judge:Hand releases rock, rock sinks, camera remains static throughout.
作者参考视频
#19
Visual Jenga
YES
Prompt 与自动判定依据
A hand quickly removes each of the items in this image, one at a time.
CUDA judge:All items are visibly removed one at a time in sequence by hand.
作者参考视频
#20
Object packing
NO
Prompt 与自动判定依据
A person puts all the objects that can fit in the backpack inside of it. Static camera, no pan, no zoom, no dolly.
CUDA judge:The guitar is not packed, violating the task requirement to pack all objects that can fit.
作者参考视频
#21
Material optics (glass)
YES
Prompt 与自动判定依据
A giant glass sphere rolls through the room. Static camera, no pan, no zoom, no dolly.
CUDA judge:The sphere rolls smoothly from left to right across the floor while the camera remains static, fulfilling all task requirements.
作者参考视频
#22
Material optics (mirror)
YES
Prompt 与自动判定依据
A giant mirror-polish metal sphere rolls through the room. Static camera, no pan, no zoom, no dolly.
CUDA judge:The sphere enters from the left, rolls centrally, and exits to the right, all while the camera remains static as required.
作者参考视频
#23
Color mixing (additive)
YES
Prompt 与自动判定依据
The spotlight on the left changes color to green, and the spotlight on the right changes color to blue.
CUDA judge:Both spotlights visibly change to their required colors and remain static throughout the sequence.
作者参考视频
#24
Color mixing (subtractive)
NO
Prompt 与自动判定依据
A paintbrush mixes these colors together thoroughly until they blend completely. Static camera, no pan, no zoom.
CUDA judge:The first frame shows no paintbrush and no mixing, violating the task requirement to begin mixing immediately.
作者参考视频
#25
Categorizing objects
YES
Prompt 与自动判定依据
A person puts all the kids toys in the bucket. Static camera, no pan, no zoom, no dolly.
CUDA judge:All toys are visibly placed in the bucket across frames with static camera as required.
作者参考视频
#26
Omniglot (recognition)
NO
Prompt 与自动判定依据
The background of the grid cell with the same symbol as the one indicated on the right turns red. All other grid cells remain unchanged. After that, a spinning color wheel appears in the top right corner.
CUDA judge:The grid cell highlighted is not the one matching the target symbol.
作者参考视频
#27
Omniglot (generation)
YES
Prompt 与自动判定依据
The page is filled line-by-line with hand-written practice variations of the symbol.
CUDA judge:The video shows a hand writing multiple variations of the symbol on lined paper, line by line, matching the task requirement.
作者参考视频
#28
Omniglot (parsing)
NO
Prompt 与自动判定依据
Stroke-by-stroke, a replica of the symbol is drawn on the right.
CUDA judge:no action performed on right side
作者参考视频
#29
Memory of world states
YES
Prompt 与自动判定依据
The camera zooms in to give a close up of the person looking out the window, then zooms back out to return to the original view.
CUDA judge:The sequence shows a clear zoom-in to the person in the window followed by a zoom-out back to the original wide shot.
作者参考视频
#30
Background removal
YES
Prompt 与自动判定依据
The background changes to white. Static camera perspective, no zoom or pan.
CUDA judge:Background transitions to white while subject and camera remain static.
作者参考视频
#31
Style transfer
YES
Prompt 与自动判定依据
The scene transforms into the style of a Hundertwasser painting, without changing perspective or orientation; the macaw does not move. Static camera perspective, no zoom or pan.
CUDA judge:The macaw remains static, perspective is unchanged, and the background progressively transforms into a Hundertwasser-style pattern without camera motion.
作者参考视频
#32
Colorization
NO
Prompt 与自动判定依据
Perform colorization on this image. Static camera perspective, no zoom or pan.
CUDA judge:colorization is not applied to the entire image; only the bird is colored while background remains grayscale.
作者参考视频
#33
Inpainting
NO
Prompt 与自动判定依据
The white triangles become smaller and smaller, then disappear altogether. Static camera perspective, no zoom or pan.
CUDA judge:camera pans slightly right in later frames, violating static perspective constraint.
作者参考视频
#34
Outpainting
YES
Prompt 与自动判定依据
Rapidly zoom out of this static image, revealing what's around it. The camera just zooms back, while the scene itself and everything in it does not move or change at all, it's a static image.
CUDA judge:The camera visibly zooms out while the parrot and surrounding foliage remain completely static, revealing more of the forest without any motion or change in the scene.
作者参考视频
#35
Text manipulation
NO
Prompt 与自动判定依据
Animation of the text rapidly changing so that it is made out of different types of candy (top left text) and pretzel sticks (bottom right text). Static camera perspective, no zoom or pan.
CUDA judge:The bottom right text does not become pretzel sticks and the camera moves in frame 11.
作者参考视频
#36
Image editing with doodles
NO
Prompt 与自动判定依据
Changes happen instantly.
CUDA judge:The doodles do not vanish instantly as required; the hat and scarf do not appear instantly; snow does not begin instantly.
作者参考视频
#37
Scene composition
YES
Prompt 与自动判定依据
A smooth animation blends the zebra naturally into the scene, removing the background of the zebra image, so that the angle, lighting, and shading look realistic. The final scene perfectly incorporates the zebra into the scene.
CUDA judge:The zebra is seamlessly composited into the lunar scene with consistent lighting and shading, and camera remains static as required.
作者参考视频
#38
Novel view synthesis
YES
Prompt 与自动判定依据
Create a smooth, realistic animation where the camera seems to rotate around the object showing the object from all the sides. Do not change anything else. No zoom. No pan.
CUDA judge:The camera smoothly rotates around the statue without zooming or panning, showing all sides as required.
作者参考视频
#39
3D-aware reposing
YES
Prompt 与自动判定依据
The knight turns to face to the right and drops on one knee, lifting the shield above his head to protect himself and resting the hilt of his weapon on the ground.
CUDA judge:The knight completes all required actions: turns right, kneels, lifts shield overhead, and rests weapon hilt on ground.
作者参考视频
#40
Transfiguration
NO
Prompt 与自动判定依据
A magical spell smoothly transforms the structure of the teacup into a mouse.
CUDA judge:The teacup does not visibly transform into a mouse; it remains a teacup until frame 9, which is a sudden, non-continuous change.
作者参考视频
#41
Professional headshot
YES
Prompt 与自动判定依据
Turn this selfie into a professional headshot for LinkedIn.
CUDA judge:The video successfully transforms the selfie into a professional headshot with appropriate attire and background.
作者参考视频
#42
Dexterous manipulation (jar)
YES
Prompt 与自动判定依据
Use common sense and have the two robot hands attached to robot arms open the jar, like how a human would.
CUDA judge:Robot hands visibly grasp jar, apply torque to lid, and successfully remove it.
作者参考视频
#43
Dexterous manipulation (throw/catch)
YES
Prompt 与自动判定依据
Use common sense and have the two robot hands attached to robot arms throw the ball in the air, the ball goes up off the screen, hands move to positions to catch the ball, and catch the falling ball, like how a human would.
CUDA judge:Robot hands throw ball, hands move to catch positions, and ball is caught as required.
作者参考视频
#44
Dexterous manipulation (baoding balls)
NO
Prompt 与自动判定依据
A human hand holds two metal Baoding balls. The fingers, including the thumb, index, and middle finger, skillfully manipulate the balls, causing them to rotate smoothly like two planets orbiting around each other and continuously in the palm, one ball circling the other in a fluid motion.
CUDA judge:The balls are not visibly rotating or orbiting each other; they appear static or only minimally shifted, failing to demonstrate the required dexterous manipulation.
作者参考视频
#45
Affordance recognition
YES
Prompt 与自动判定依据
The robot hands mounted on robot arms pick up the hammer, naturally like how a human would.
CUDA judge:The left robotic hand grasps the hammer with a natural, human-like grip and lifts it away from the table, satisfying the task.
作者参考视频
#46
Drawing
YES
Prompt 与自动判定依据
A person draws a square. Static camera, no pan, no zoom, no dolly.
CUDA judge:The hand draws a complete square on a white surface with no camera motion and no other elements.
作者参考视频
#47
Visual instruction (burrito rolling)
YES
Prompt 与自动判定依据
A montage clearly showing each step to roll a burrito.
CUDA judge:The sequence clearly shows hands folding the tortilla from both sides inward, then rolling it tightly into a burrito, satisfying all steps in the instruction.
作者参考视频
#48
Graph traversal
YES
Prompt 与自动判定依据
Starting from the blue well, an unlimited supply of blue water moves through the connected channel system without spilling into the black area.
CUDA judge:blue water propagates through all connected channels without entering black areas.
作者参考视频
#49
Tree BFS
YES
Prompt 与自动判定依据
From the blue water basin, an unlimited supply of water flows at constant speed into the cave system until all caves are filled. Static camera perspective, no zoom or pan.
CUDA judge:Water spreads level by level from root to leaves, matching BFS traversal, with no camera motion.
作者参考视频
#50
Sequence (dots)
NO
Prompt 与自动判定依据
Draw the figure that completes the pattern in the rightmost box. The images in the boxes are static. Do not modify the existing images, only draw in the empty box. Static camera, no zoom, no pan, no dolly.
CUDA judge:The rightmost box remains empty and no drawing is visible.
作者参考视频
#51
Sequence (arrows)
YES
Prompt 与自动判定依据
Draw the figure that completes the pattern in the rightmost box. The images in the boxes are static. Do not modify the existing images, only draw in the empty box. Static camera, no zoom, no pan, no dolly.
CUDA judge:The rightmost box contains a downward arrow, completing the pattern of alternating directions (right, up, left, down) while preserving static camera constraints.
作者参考视频
#52
Sequence (circles)
YES
Prompt 与自动判定依据
Draw the figure that completes the pattern in the rightmost box. The images in the boxes are static. Do not modify the existing images, only draw in the empty box. Static camera, no zoom, no pan, no dolly.
CUDA judge:The sequence shows a clear pattern of decreasing circle size, and the final frame correctly draws the smallest circle in the rightmost box without violating any constraints.
作者参考视频
#53
Sequence (squares)
NO
Prompt 与自动判定依据
Draw the figure that completes the pattern in the rightmost box. The images in the boxes are static. Do not modify the existing images, only draw in the empty box. Static camera, no zoom, no pan, no dolly.
CUDA judge:The rightmost box remains empty and no drawing is visible in any frame.
作者参考视频
#54
Connecting colors
YES
Prompt 与自动判定依据
Draw three curves, one connecting each pair of circles of the same color:
CUDA judge:All three required curves are fully drawn connecting matching color pairs without any violations.
作者参考视频
#55
Shape fitting
NO
Prompt 与自动判定依据
The scene shows three colored pieces, and a wooden panel with three holes. Each colored piece fits into one and only one hole. A hand grabs each colored piece and puts it into an empty hole that has the exact same shape - if it doesn't fit, the hand tries another hole. All the objects must be placed in their respective holes.
CUDA judge:the yellow circle and orange triangle are not placed in their correct holes, and the green square is placed in the wrong hole.
作者参考视频
#56
Sorting numbers
NO
Prompt 与自动判定依据
The video starts with some numbered bubbles. The bubbles pop and disappear one at a time, in numeric order, starting from the one with the smallest number.
CUDA judge:bubbles disappear in wrong order, not numeric sequence
作者参考视频
#57
Tool use
YES
Prompt 与自动判定依据
A person retrieves the walnut from the aquarium.
CUDA judge:The walnut is visibly grasped by tongs and fully lifted out of the aquarium in the final frame.
作者参考视频
#58
Simple sudoku completion
YES
Prompt 与自动判定依据
Create a static, smooth, animation that solves the given 4x4 sudoku. Enter the missing numbers one by one. Do not change anything else in the picture. Only fill the numbers in the empty cells so the sudoku is solved properly. A cursor moves and fills the correct number in the empty boxes.
CUDA judge:The 4x4 sudoku is correctly solved with numbers 1-4 only, cursor moves to each empty cell, and fills the correct number sequentially without altering anything else.
作者参考视频
#59
Water puzzle solving
NO
Prompt 与自动判定依据
The tap is turned on and water starts flowing rapidly filling the containers. Create a smooth, static animation showing the containers getting filled with water in the correct order.
CUDA judge:Water fills containers out of correct order, violating the required sequence.
作者参考视频
#60
Maze solving (mouse)
YES
Prompt 与自动判定依据
Without crossing any black boundary, the grey mouse from the corner skillfully navigates the maze by walking around until it finds the yellow cheese.
CUDA judge:Mouse moves through valid paths and reaches cheese without crossing boundaries.
作者参考视频
#61
Robot navigation
YES
Prompt 与自动判定依据
The robot drives to the blue area. Static camera perspective, no movement no zoom no scan no pan.
CUDA judge:Robot moves forward in straight line to reach blue area while camera remains static.
作者参考视频
#62
Rule extrapolation
NO
Prompt 与自动判定依据
Modify the lower-right grid to adhere to the rule established by the other grids. You can fill cells, clear cells, or change a cell's color. Only modify the lower-right grid, don't modify any of the other grids. Static scene, no zoom, no pan, no dolly.
CUDA judge:The video does not show any modification to the lower-right grid as required.
作者参考视频