Skip to content
View joses2017smjh's full-sized avatar

Block or report joses2017smjh

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
joses2017smjh/README.md

Jose Sanchez Gonzalez

I build robot perception, control, and AI software—from humanoid simulation and physical arm teleoperation to retrieval tools that show their sources.

Seeking robotics software, embodied AI, computer vision, and AI/software engineering roles. M.S. Artificial Intelligence and B.S. Computer Science, Oregon State University.

Portfolio · Résumé · LinkedIn · Email

Humanoid Simulation

A simulated humanoid explores a maze with lidar mapping and sensor displays

Learned gait with scripted planning and oracle pose/goal, at 5× playback. A selected simulation rollout; sensor display panels are separate from the control inputs.

Three areas in Humanoid Robustness Ladder:

  • Locomotion & Control — Isaac Lab training, MuJoCo qualification, disturbances, and terrain rollouts. Recent turning and terrain studies retain their exact controller and evaluation scope.
  • Perception & Navigation — Online lidar mapping, maze planning, sensor-fault studies, and matched navigation controls.
  • Language-Guided Manipulation — SmolVLA selects a tumbler, loads a tray, and carries it to the instructed table. 76/100 held-out-phrasing successes in simulation, with standing assistance and a small instruction domain.

RAG & Agents

Illustrated MetaNaviT query and source-inspection workflow

Illustrated retrieval workflow on demo files. Quantitative retrieval evaluations are documented separately.

  • MetaNaviT — Hybrid retrieval over research files, source tracing, reviewable file operations, MCP tools, and ranking evaluations. Independent extensions build on an original six-person team project.
  • Agentic Soccer MCP — FastAPI, LangGraph, and MCP tools for soccer analysis. Historical forecasting and agent tests are separate from the synthetic demo interface.

Computer Vision & VLA

  • Bimanual Garment Folding — Camera-driven policies, cloth simulation, and paired evaluation gates. Later runtime-horizon comparisons remain inconclusive; the baseline is retained.
  • Vision-Guided Pruning — RGB-D branch tracking, sensor-gated release, and independent checks of recorded successes and failures in Isaac Sim.
  • SPUR Metric Depth — PyTorch depth models, RGB-D branch perception, a FastAPI service, and ONNX export. Synthetic depth results are measured; real-orchard accuracy remains unverified.

Physical robotics

Quest VR Teleoperation connects WebXR controller poses to inverse kinematics and SocketCAN arm control. Calibration checks cover ten arm joints. Watch the hardware preview.

Technical focus

Robotics & vision: Python, C++, PyTorch, OpenCV, Isaac Sim / Isaac Lab, MuJoCo, ROS 2, SocketCAN, ONNX Runtime.

AI & software: FastAPI, PostgreSQL / pgvector, hybrid retrieval, RAG, MCP, Docker, and Slurm.

The portfolio presents short visual case studies. The repositories contain setup, architecture, dated results, and current limits.

Pinned Loading

  1. bhl-robustness-ladder bhl-robustness-ladder Public

    Humanoid locomotion, navigation, and language-guided manipulation in simulation: Isaac Lab/MuJoCo studies, sensor tests, and reproducible evaluation gates.

    Python

  2. isaac-sim-pruning-workflow isaac-sim-pruning-workflow Public

    Vision-guided UR5e pruning in Isaac Sim: RGB-D approach, sensor-gated release, and independently checked success and failure recordings.

    Python

  3. IsaacSimFolding IsaacSimFolding Public

    Camera-driven bimanual garment folding in Isaac Sim, with policy integration, paired evaluations, and checkpoint promotion gates.

    Python

  4. MetaNavT MetaNavT Public

    Hybrid retrieval and RAG over research files, with source tracing, reviewable file operations, MCP tools, and reproducible ranking benchmarks.

    Python