[REPORT SETUP] Extended reporter skill by Java, Python, XML reports by mykhailiukVitalii · Pull Request #82 · testomatio/skills

mykhailiukVitalii · 2026-04-28T17:06:26Z

Extended reporter-setup skill by Java, Python, XML reports.
Need to verify on the different project setups/env.

@GolubNick if you have any chance to look JAVA section description and test.

mykhailiukVitalii · 2026-04-29T15:45:56Z

I think, you can leave you examples or comments about Java or Python install steps if need.

…ixes

mykhailiukVitalii · 2026-05-01T08:57:43Z

I fixed instructions based on your comments.
If you have a chance to look - welcome @GolubNick @AenEnlil (maybe I missed something)

if you have a chance try this skill locally - GO ahead!

DavertMik

Improvements
Add DONE state
Steps order

DavertMik · 2026-05-05T11:17:45Z

+
+Use the appropriate `@testomatio/reporter` for Java test frameworks (JUnit, TestNG).
+
+#### Install


Import tests first

DavertMik · 2026-05-05T11:22:03Z

 Agent: Please replace API token in `.env` file
 Agent: Run tests with: npx playwright test and push results to TMS
 ```



Steps

Detect frameowrk

Import tests

Install reporter

Suggest to run tests to report

Reported == DONE

DONE: Connect to MCP to check new Run was published!

Troubleshooting (Testomatio Key, .. ...)
ARTIFACTS!!!!!

GolubNick · 2026-05-05T12:55:50Z

+
+> **More examples or extra framework configuration** you can find in [Testomat.io Reporters NodeJS Test Frameworks Configuration](https://docs.testomat.io/test-reporting/frameworks/)
+
+### Java


java-check-tests

UNIX/LINUX

import

export TESTOMATIO=... && \ curl -L -O https://github.com/testomatio/java-check-tests/releases/latest/download/testomatio.jar && \ java -jar testomatio.jar import

sync

export TESTOMATIO=... && \ curl -L -O https://github.com/testomatio/java-check-tests/releases/latest/download/testomatio.jar && \ java -jar testomatio.jar sync

pull ids

export TESTOMATIO=... && \ curl -L -O https://github.com/testomatio/java-check-tests/releases/latest/download/testomatio.jar && \ java -jar testomatio.jar pull-ids

clean ids

curl -L -O https://github.com/testomatio/java-check-tests/releases/latest/download/testomatio.jar && \ java -jar testomatio.jar clean-ids

WINDOWS

import

set TESTOMATIO=...&& ^ curl -L -O https://github.com/testomatio/java-check-tests/releases/latest/download/testomatio.jar&& ^ java -jar testomatio.jar import

sync

set TESTOMATIO=...&& ^ curl -L -O https://github.com/testomatio/java-check-tests/releases/latest/download/testomatio.jar&& ^ java -jar testomatio.jar sync

pull-ids

set TESTOMATIO=...&& ^ curl -L -O https://github.com/testomatio/java-check-tests/releases/latest/download/testomatio.jar&& ^ java -jar testomatio.jar pull-ids

clean-ids

curl -L -O https://github.com/testomatio/java-check-tests/releases/latest/download/testomatio.jar&& ^ java -jar testomatio.jar clean-ids

DavertMik

Debugging in Java & Python
Artifacts !!!!!
Import move to standalone skill
JUnit XML from C#, Ruby, etc => add section about them. Write detailed on command

npx @testomatio/reporter xml ....

DavertMik · 2026-05-08T11:14:26Z

-(More info you can find in [Testomat.io DEBUG Pipe](./references/TESTOMATIO_DEBUG_PIPE.md) )
-
-#### 🧾 HTML Report Mode (Alternative)
+### HTML Report Mode (Alternative)


Replace with Markdown pipe once it is merged

DavertMik · 2026-05-08T11:15:04Z

 Enable Debug pipe by setting the environment variable:

 ```bash
 TESTOMATIO_DEBUG=1 npx <your-test-command>


DEBUG="@testomatio/reporter:*"

DavertMik · 2026-05-08T11:15:39Z

@@ -135,42 +283,47 @@

 **After running,** read the test execution logs to detect whether the Testomat.io reporter is enabled and configured correctly.


Add debugging for Java & Python reporters

@GolubNick what options? what log files to read? errors? debug logs how to enable

@AenEnlil add docs about debug command

Move debugging sections to framework sections
Debug is subsection for Java/Python/JS

DavertMik · 2026-05-08T11:18:48Z

-### Step 4: Verify Setup
+## Step 4: Verify Setup

 Run your tests with the Testomat.io reporter to ensure everything is configured correctly.


Read logs of tests to understand if report was created
Preferred to use MCP to fetch latest run to check data was sent

DavertMik · 2026-05-08T11:21:35Z

-### Step 5: Import Tests to TMS
+## Step 5: Import Tests to TMS


Move importing to another skill

Java + Python must be included!

DavertMik · 2026-05-08T11:22:12Z

@@ -184,8 +337,6 @@

 Next steps:
 1. Execute tests and push run results to TMS:


Just follow verification step

DavertMik · 2026-05-11T19:02:49Z

Workflow:

import
repotr
configure artifacts + report

JS/TS/Java/Kotlin/Python (Pytest)

check-tests => to import (java-check-tests / pytest --sync) (optional but preferred step)
execute test runner with reporter enabled (list all reporter env vars)

Other (C#, Swift, Go, etc)

generate JUnit XML report
run XML report to import+report (env vars can be different)

Add Artifacts as section (optional but preferred step)

Ask user to create a bucket (help user creating bucket if ASKED to do so)
Prefer to ask user to set artifacts config in UI (secure, no credentials exposed) - provide URL for project/settings/artifacts so skill could print correct instructions

If asked for IAM Role Support refer to docs

Artifacts setup needed after first report executed and all tests reported succesfully. If screenshots videos logs needed to be save suggets using artifacys feature
(optional step)

mykhailiukVitalii · 2026-05-11T19:03:56Z

What need to cover:

Detect framework
Import tests (check-tests by framework by "Import Tests form Source Code") - before install: import in Java nad Python (Excluded from XML)
-- check-tests analogs for java/python
Install reporter
Suggest to run tests to report
Reported == DONE (DONE: Connect to MCP to check new Run was published!)
(Troubleshooting (Testomatio Key, .. ...))

ARTIFACTS!! - as separate skill?
Maybe "Import tests" as separate because in XML - we don't have needed options.
TBD: after call

mykhailiukVitalii self-assigned this Apr 28, 2026

mykhailiukVitalii requested a review from GolubNick April 28, 2026 17:06

mykhailiukVitalii mentioned this pull request Apr 28, 2026

Extend reporter skill for all frameworks #81

Open

mykhailiukVitalii changed the title ~~[REPORT SETUP] Extended reporter skill by Java, Python, XML reports~~ DRAFT - [REPORT SETUP] Extended reporter skill by Java, Python, XML reports Apr 28, 2026

DavertMik requested changes Apr 29, 2026

View reviewed changes

Comment thread skills/reporter-setup/SKILL.md Outdated

Comment thread skills/reporter-setup/SKILL.md Outdated

Comment thread skills/reporter-setup/SKILL.md Outdated

GolubNick reviewed Apr 30, 2026

View reviewed changes

Comment thread skills/reporter-setup/SKILL.md Outdated

GolubNick reviewed Apr 30, 2026

View reviewed changes

Comment thread skills/reporter-setup/SKILL.md Outdated

GolubNick reviewed Apr 30, 2026

View reviewed changes

Comment thread skills/reporter-setup/SKILL.md

AenEnlil requested changes May 1, 2026

View reviewed changes

Comment thread skills/reporter-setup/SKILL.md Outdated

Comment thread skills/reporter-setup/SKILL.md Outdated

Comment thread skills/reporter-setup/SKILL.md Outdated

Comment thread skills/reporter-setup/SKILL.md

mykhailiukVitalii added 3 commits May 1, 2026 10:54

[REPORT SETUP] Extended reporter skill by Java, Python, XML reports

0eee78b

[REPORT SETUP] Extended reporter skill by JS, Java, Python - review f…

55911f2

…ixes

[REPORT SETUP] Dev comments is added

3b55760

mykhailiukVitalii force-pushed the fix/reporter-setup-all-frameworks branch from 4e05a4d to 3b55760 Compare May 1, 2026 08:53

mykhailiukVitalii changed the title ~~DRAFT - [REPORT SETUP] Extended reporter skill by Java, Python, XML reports~~ [REPORT SETUP] Extended reporter skill by Java, Python, XML reports May 1, 2026

mykhailiukVitalii requested a review from DavertMik May 1, 2026 09:58

AenEnlil reviewed May 1, 2026

View reviewed changes

Comment thread skills/reporter-setup/SKILL.md Outdated

AenEnlil approved these changes May 1, 2026

View reviewed changes

[REPORT SETUP] Small toml/yaml fix

e78bbc7

DavertMik requested changes May 5, 2026

View reviewed changes

GolubNick reviewed May 5, 2026

View reviewed changes

[REPORT SETUP] Remove unnecessary sections

6defce1

DavertMik requested changes May 8, 2026

View reviewed changes


		Use the appropriate `@testomatio/reporter` for Java test frameworks (JUnit, TestNG).

		#### Install


		> More examples or extra framework configuration you can find in [Testomat.io Reporters NodeJS Test Frameworks Configuration](https://docs.testomat.io/test-reporting/frameworks/)

		### Java

		@@ -135,42 +283,47 @@

		After running, read the test execution logs to detect whether the Testomat.io reporter is enabled and configured correctly.

		### Step 5: Import Tests to TMS
		## Step 5: Import Tests to TMS

		@@ -184,8 +337,6 @@

		Next steps:
		1. Execute tests and push run results to TMS:

Conversation

mykhailiukVitalii commented Apr 28, 2026

Uh oh!

Uh oh!

Uh oh!

Uh oh!

mykhailiukVitalii commented Apr 29, 2026

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

mykhailiukVitalii commented May 1, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Uh oh!

DavertMik left a comment

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

WINDOWS

Uh oh!

DavertMik left a comment • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

DavertMik commented May 11, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

mykhailiukVitalii commented May 11, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

mykhailiukVitalii commented May 1, 2026 •

edited

Loading

DavertMik left a comment •

edited

Loading

DavertMik commented May 11, 2026 •

edited

Loading