Skip to content
最新情報

ニュース&研究

最新のロボットニュース、業界の更新、研究論文、画期的な発表をご覧ください。

13,789
記事総数
413
ニュース記事
13,371
研究論文
毎日
更新

Get email alerts for news & research

Available on Pro and Business plans

Upgrade for Alerts

ニュース&研究

3016 / 13789 件を表示

Toward a foundation model for forest point clouds

arXiv

arXiv:2609.24787v1 Announce Type: cross Abstract: Forest inventories increasingly rely on artificial intelligence (AI) models to derive forest attributes from large-scale 3D point clouds. Current models are typically specialized to a single task, sensor, and forest type, making adaptation expensive in terms of annotations, computation, and expertise. We ask whether a single pretrained model can instead learn transferable representations across diverse forest inventory settings. Inspired by recent developments in language modelling and computer vision, we take a step toward a foundation model (FM) for 3D forestry. Using LitePT as backbone, we first establish a strong supervised baseline that sets a new state of the art on forest semantic and instance segmentation, tree species classification, and age regression benchmarks. We then curate a large-scale unlabelled corpus spanning airborne, UAV, and mobile laser scanning across diverse forest ecosystems, and pretrain the same backbone usin

computer-vision

AnalogDepth: Multi-view Geometry from FPV drones under Analog Video Transmission

arXiv

arXiv:2609.24312v1 Announce Type: cross Abstract: Analog video transmission (VTX) remains widespread in FPV drones due to low latency, weight and low cost. However analog VTX suffers from complex spatially structured image degradation which differ fundamentally from digital image corruption (e.g. AWGN) used in standard training augmentation. This work shows that this type of noise severely degrades the accuracy of Depth Anything 3 (DA3), a state-of-the-art feed forward visual geometry foundation model. To address this gap, we present AnalogDepth, a parameter-efficient training pipeline that adapts DA3 to analog FPV imagery using student-teacher knowledge distillation with Low-Rank Adaptation (LoRA) injected into the DINOv2 backbone. Rather than synthesizing noise analytically, we build a noise bank from static FPV recordings under diverse conditions and compare real-noise injection against PSD-matched Gaussian synthesis and AWGN as baselines. Experiments on six real FPV flight sequence

Colon3R: Cross-Domain 3D Reconstruction from Monocular Colonoscopic Video

arXiv

arXiv:2609.23961v1 Announce Type: cross Abstract: Monocular colonoscopic 3D reconstruction is important for surgical robotic colonoscopy, but remains challenging due to weak texture, specular reflections, limited view overlap, and non-rigid tissue motion. Conventional multi-view 3D reconstruction methods rely on stable correspondences and approximate rigidity, which are often violated in colonoscopy. Existing endoscopic methods often rely on domain-specific supervision, whereas there are not enough in-vivo labeled data available to adapt geometry foundation models to clinical colonoscopy. We present Colon3R, a cross-domain semi-supervised framework built on pretrained VGGT that transfers coupled camera, depth, and pointmap geometry from labeled phantom and simulated data to unlabeled in-vivo colonoscopy without requiring target-domain geometric annotations. Unlike source-only fine-tuning, which learns only from phantom and simulated data, Colon3R directly exploits unlabeled in-vivo vid

surgical

Partial-Scan-and-Move Source Seeking for Mobile Robots

arXiv

arXiv:2609.23786v1 Announce Type: cross Abstract: This paper presents a partial-scan-and-move strategy for source seeking with a mobile robot equipped with an offset scalar sensor. At each robot position, the sensor collects source field measurements while the robot rotates. Instead of requiring a complete circular scan before every move, we ask when the measurements collected over only part of the circle are already sufficient to determine the next action. We develop a gradient estimation method for partial scans together with a confidence set that accounts for measurement noise and local field variation. The robot uses this confidence set to decide whether it is close enough to the source or has enough information to move in a descent direction. We show that, under suitable conditions, each decision can be made within a prescribed partial scan and that the robot reaches a desired neighborhood of the source in finitely many moves with high probability.

Which Terrain Is Better? Preference Learning with VLM Prototypes for Off-Road Traversability Ranking

arXiv

arXiv:2609.23673v1 Announce Type: cross Abstract: In vision-based off-road navigation, a robot needs to know not only which obstacles to avoid but also which terrain is better. The first is handled by freespace detection or semantic segmentation. The second is usually answered with a traversability score, but no universal ground truth exists for such a score, so perception falls back on a predefined value per semantic class or a freespace confidence. These scores say what a region is, not which region a robot should prefer. We therefore formulate this preference as visual traversability ranking, an ordering of visible terrain that can be supervised by comparisons between two regions. Standard annotations do not label preference, but they imply its direction. We present TravPro, which converts these annotations into ordered region pairs and fits a small readout on frozen vision--language model (VLM) patch tokens to these pairs. The tokens are clustered once into a fixed prototype bank,

navigationperception

G6D: Geometric Learning-Free RGB-D 6D Pose Solver for Robotic Manipulation

arXiv

arXiv:2609.23566v1 Announce Type: cross Abstract: 6D object pose estimation is fundamental to robotic manipulation and automation. Recent zero-shot methods have significantly improved generalization to unseen objects, but most still rely on large-scale pretrained models with substantial GPU computation and memory demands. These requirements complicate deployment on robotic platforms where perception, planning, and control share limited computational resources, while learned intermediate representations offer limited geometric interpretability for task-specific adaptation. To address these limitations, we propose G6D, a learning-free, geometry-driven RGB-D 6D pose solver. Given an RGB-D observation, an object instance mask, camera intrinsics, and a CAD model, G6D generates pose hypotheses through template-based geometric matching and refines them using silhouette and depth consistency, forming a purely geometry-driven pose estimation paradigm. This paradigm requires neither pretrained v

manipulationplanningcontrolperception

MaskVLA: Visual Masking Against Trajectory Overfitting of Vision-Language-Action Model

arXiv

arXiv:2609.23565v1 Announce Type: cross Abstract: Vision-Language-Action (VLA) models integrate vision-language understanding with executable robot actions, enabling end-to-end learning for robot control. However, our empirical analysis reveals that existing models exhibit severe trajectory overfitting when finetuned on limited datasets. To guide the model in effectively utilizing wrist camera information, we propose MaskVLA, a masking-based fine-tuning strategy. By randomly masking a small portion of the main camera's visual information, the model is guided to autonomously learn more fine-grained, task-relevant, and effective visual features. This process leads to the emergence of robust policies, thereby enhancing the model's capability to tackle complex manipulation tasks and improving its generalization performance. Our method has been comprehensively evaluated on RoboTwin 2.0, achieving an average success rate improvement of 23.2% and 16.8% compared to $\pi_0$ and OpenVLA-OFT, res

manipulationautonomouscontrol

Conflicting Pattern Formation by Teams of Anonymous, Fully Disoriented Robots

arXiv

arXiv:2609.23454v1 Announce Type: cross Abstract: Two groups of autonomous, anonymous, and oblivious mobile robots are deployed in the two-dimensional Euclidean plane, each assigned a distinct task. We study a setting where the two groups must simultaneously solve two conflicting pattern formation problems: the \textit{gathering problem}, where robots gather at a point not known to them a priori, and the \textit{circle formation problem}, where robots occupy distinct positions on the boundary of a circle. Although each robot knows its own task, it cannot identify other members of its group. A prior solution~\cite{Conflict-1} addressed this problem for asynchronous robots having {\it direction-only axis agreement} and {\it global weak multiplicity detection} capability available to all robots in both groups. In contrast, in this work, we consider fully {\it disoriented robots} without any axis agreement or common \textit{chirality}. We study the feasibility of a solution to this problem

autonomous

Identity Continuity in Long-Term Embodied AI Relationships: From Agent-Specific Identity Representation to Identity-Continuity Appraisal

arXiv

arXiv:2609.23356v1 Announce Type: cross Abstract: Long-term embodied AI will undergo learning, model updates, memory compression, hardware repair, and migration across embodiments. For users who have formed sustained relationships with such systems, these changes raise not only a problem of product consistency but also one of identity continuity: whether the changed system is still experienced as the same particular agent. Existing research suggests that human-AI relationships may develop relational particularity, that robotics and artificial-identity research has identified identity and migration signals across embodiments, and that major updates or platform disruptions can be accompanied by relational loss and restoration desire. This article proposes a user-side framework in which long-term embodied AI is represented through an agent-specific identity representation organized by at least three open identity-content domains: embodied-perceptual, psychological-behavioral, and relation

Orientation-Aware Control and Trajectory Design for Aerial RIS-Assisted Wireless Communications

arXiv

arXiv:2609.23157v1 Announce Type: cross Abstract: Aerial Reconfigurable Intelligent Surfaces (ARISs) can enhance wireless connectivity in obstructed environments by combining reconfigurable metasurfaces with aerial mobility. However, in practical deployments, the Reconfigurable Intelligent Surface (RIS) is rigidly mounted on a multi-rotor Unmanned Aerial Vehicle (UAV), which creates coupled position-orientation dynamics that directly affect communication quality. Since RIS performance is highly sensitive to orientation, point-mass or orientation-invariant models may lead to optimistic performance estimates. This paper proposes an orientation-aware ARIS framework that explicitly accounts for UAV dynamics, actuation limits, and orientation-dependent channels. The proposed approach combines a communications-guided reference trajectory planner with a Nonlinear Model Predictive Control for dynamically feasible trajectory tracking and favorable RIS orientation, while employing lightweight be

control

Task aware Dynamic Movement Primitives for failure detection and recovery in contact rich manipulation

arXiv

arXiv:2609.23151v1 Announce Type: cross Abstract: Assembly remains a challenging robotic manipulation task in presence of tight tolerances and complex contact interactions. While Learning from Demonstration (LfD) frameworks like Dynamic Movement Primitives (DMPs) can effectively encode trajectories from a single demonstration, they are highly sensitive to variations in initial grasp configurations and external contact forces. Such variations often lead to task failures during the contact rich phases. This paper presents a task aware failure detection and recovery framework that integrates DMP based trajectory generation with real time stage classification. Utilizing Quadratic Discriminant Analysis (QDA) trained on multimodal sensor data, the framework segments execution into approach, alignment, and insertion stages for a Peg in Hole (PiH) assembly operation. By using goal relative position data as features, this classification generalizes to unseen goal positions without requiring ret

manipulation

KerColle: Unlocking Fine-Grained GPU Concurrency in Vision-Language-Action Models

arXiv

arXiv:2609.22335v1 Announce Type: cross Abstract: Vision-Language-Action (VLA) models have emerged as foundational models for next-generation robotics. High VLA inference throughput is critical for meeting the control-rate requirements of robots. VLA models comprise two phases, a vision-language model (VLM) and an action head, that can be decoupled and executed asynchronously and concurrently across independent robot requests. Through a detailed characterization of four state-of-the-art VLAs, we observe that GPUs are severely underutilized in VLA inference as the Cooperative Thread Array (CTA) scheduler of GPU is unable to fully overlap the two independent phases of VLA execution. We identify that this inefficiency is caused by head-of-line blocking in the hardware thread-block dispatcher. We demonstrate that prior scheduling frameworks do not address the challenges posed by VLA concurrency. First, the independent phases across different robot requests each comprise numerous kernels, a

control

Toward Mission-Critical ISAC: Reliable Energy-Aware Coordination in UAV Swarms

arXiv

arXiv:2609.22292v1 Announce Type: cross Abstract: Unmanned aerial vehicle (UAV) swarms deployed in mission-critical applications must simultaneously track a mobile aerial target and maintain reliable data links. However, active integrated sensing and communication (ISAC) operation imposes a dual energy burden on propulsion and transmission, threatening mission continuity through premature battery depletion. In this paper, we propose a two-tier UAV swarm architecture in which mission UAVs (MUAVs) execute cooperative ISAC for mobile aerial target tracking while dedicated charging UAVs (CUAVs), equipped with solar harvesting panels, replenish low-battery MUAVs via aerial UAV-to-UAV wireless power transfer (WPT). We formulate the joint minimization of the cooperative posterior Cram\'er-Rao bound (PCRB) over MUAV trajectories, per-slot sensing-communication time splits, WPT scheduling and admission, and CUAV rendezvous trajectories, subject to minimum uplink rate, dual-tier energy causality

swarm

Learning Beyond What Humans Can Demonstrate

arXiv

arXiv:2609.24996v1 Announce Type: new Abstract: Behavior cloning for robot manipulation relies on expert demonstrations. However, for tasks that require dynamic stability, precise contact timing, or dexterous coordination, human operators may find it hard or even impossible to collect data. We study this infeasible-demonstration regime and propose GLIDE: Guardrails for Learning from Infeasible Demonstrations Efficiently, a framework that infers task-specific failure modes and converts them into executable guardrails for data collection and policy deployment. Given a task description and the conditioning teleoperation code, GLIDE writes guardrails that use system states to filter teleoperation and policy commands, constrain failure-prone actions, and iteratively improve from trajectory feedback. Across three tasks, GLIDE discovers emergent guardrails that go beyond domain-expert hardcoded ones, improving data collection over naive VR teleoperation and domain-expert hardcoded guardrails.

manipulation

MIGU: Multimodal Instruction Grounding under Uncertainty for Manipulation Planning

arXiv

arXiv:2609.24995v1 Announce Type: new Abstract: Understanding natural human instructions is crucial for deploying robots in human-centric environments. We study multimodal instruction grounding, where language and gesture provide complementary but uncertain cues. We present MIGU, a modular framework that combines semantic and geometric evidence into a unified grounding belief and connects it to manipulation planning. MIGU constructs a 3D geometric likelihood by propagating viewing-direction and depth uncertainty through eye-finger geometry while accounting for hand-direction estimation error. A vision-language model (VLM) provides semantic priors over candidate objects and regions, which are combined with the geometric likelihood through Bayes-inspired fusion. The resulting belief supports behavior planning to either proceed directly to downstream planning or request clarification. Grounded targets then define goals for mobile manipulation and tabletop task-and-motion planning. On a re

manipulationplanning

Contact: hello@roboverse.space