Robo‐Saber: Generating and Simulating Virtual Reality Players
Abstract We present the first motion generation system for playtesting virtual reality (VR) games. Our player model generates VR headset and handheld controller movements from in‐game object arrangements, guided by style reference gameplay examples. We train on the large BOXRR‐23 dataset and apply our framework on the popular VR game Beat Saber.
N. H. Kim +5 more
wiley +1 more source
Neural Outlier Rejection For Self-Supervised Keypoint Learning
Identifying salient points in images is a crucial component for visual odometry, Structure-from-Motion or SLAM algorithms. Recently, several learned keypoint methods have demonstrated compelling performance on challenging benchmarks.
Tang, Jiexiong, +4 more
core
Non‐Rigid 3D Shape Correspondences: From Foundations to Open Challenges and Opportunities
Abstract Estimating correspondences between deformed shape instances is a long‐standing problem in computer graphics; numerous applications, from texture transfer to statistical modelling, rely on recovering an accurate correspondence map. Many methods have thus been proposed to tackle this challenging problem from varying perspectives, depending on ...
A. Zhuravlev +14 more
wiley +1 more source
Research on the applicability of image keypoints in underground mine environments
The keypoint algorithm, as a fundamental algorithm in machine vision, plays a crucial role in enhancing the visual perception capabilities of new mining equipment. The keypoint algorithm can be applied across various mining tasks.
WANG Jiawen +7 more
doaj +1 more source
Step2Motion: Locomotion Reconstruction from Pressure Sensing Insoles
Abstract Human motion is fundamentally driven by continuous physical interaction with the environment. Whether walking, running, or simply standing, the forces exchanged between our feet and the ground provide crucial insights for understanding and reconstructing human movement. Recent advances in wearable insole devices offer a compelling solution for
J. L. Ponton +5 more
wiley +1 more source
Learning local descriptors by optimizing the keypoint-correspondence criterion
Current best local descriptors are learned on a large dataset of matching and non-matching keypoint pairs. However, data of this kind is not always available since detailed keypoint correspondences can be hard to establish.
Igor S. Pandzic +5 more
core +1 more source
SAGE: Structure‐Aware Generative Video Transitions between Diverse Clips
Abstract Video transitions aim to synthesize intermediate frames between two clips, but naïve approaches such as linear blending introduce artifacts that limit professional use or break temporal coherence. Traditional techniques (cross‐fades, morphing, frame interpolation) and recent generative inbetweening methods can produce high‐quality plausible ...
Mia Kan, Yilin Liu, Niloy J. Mitra
wiley +1 more source
Representation Learning for Robot Keypoint Detection using Prior Kinematic Knowledge [PDF]
We introduce the Prior Knowledge Robot Keypoint Detection (PK-ROKED) approach for 2D keypoint detection on a robot arm. Our proposed method comprises a Deep Learning network, which learns a representation of keypoints based on prior kinematic knowledge ...
Klüpfel, Leonard
core
Keypoint-based modeling reveals fine-grained body pose tuning in superior temporal sulcus neurons
Body pose and orientation serve as vital visual signals in primate non-verbal social communication. Leveraging deep learning algorithms that extract body poses from videos of behaving monkeys, applied to a monkey avatar, we investigated neural tuning for
Rajani Raman +6 more
doaj +1 more source
Geometry‐Aware Alignment and Comparison of Hierarchical Morse Complexes with Applications
Abstract Scalar fields derived from 3D X‐ray CT scans of samples undergoing ex situ processes, such as thermal aging, chemical etching, or mechanical stress, pose unique challenges for characterizing similarities and differences across acquisitions. Typically, a sample A (source) is imaged, removed, and subjected to experimental conditions that alter ...
Aniketh Venkat +3 more
wiley +1 more source

