Skip to content

feat: skill for parser creator#2962

Open
Kawron wants to merge 11 commits intodevelopfrom
feat/ai-parser-creator
Open

feat: skill for parser creator#2962
Kawron wants to merge 11 commits intodevelopfrom
feat/ai-parser-creator

Conversation

@Kawron
Copy link
Copy Markdown
Collaborator

@Kawron Kawron commented Mar 17, 2026

This is a draft of an AI agent skill (using agentskills specification: https://agentskills.io/home) for SC4S. This agent can be used to create parsers. For now it supports RFC5424 RFC3164 and CEF formats. It can correctly match and parse logs. It also creates and runs unit tests. To use unit test you need docker compose installed.

Example on how to start conversation:

(USER) Create a parser for new sourcetype
(BOT) To create an SC4S parser, I need these details:

Vendor – vendor name in lowercase (e.g. acme)
Product – product name in lowercase (e.g. firewall)
Sourcetype – Splunk sourcetype, usually vendor:product (e.g. acme:firewall)
Index – Splunk index (e.g. netfw, netops)
Sample logs – one or more raw syslog messages (exact lines as sent by the device/app)
Reply with those five items and I’ll create the parser (and tests) for both the main and lite packages.

(USER)
vendor: jatp
product: cortex
sourcetype: jatp:cortex
index: netfw
log:
Dec 6 16:52:22 IP Dec 06 16:51:38 hostname
CEF:0|JATP|Cortex|3.6.0.1444|email|Phishing|8|externalId=1504
eventId=14067 lastActivityTime=2016-12-06 23:51:38+00 src=kwrona dst=kwrona
src_hostname=kwrona dst_hostname=kwrona src_username=kwrona dst_username=
mailto:src_email_id=src@abc.comdst_email_id={mailto:test@abc.com} startTime=2016-12- 06 23:51:38+00 url=http://greatfilesarey.asia/QA/files_to_pcaps/74280968a4917da52b5555351eeda969.bin
fileHash=bce00351cfc559afec5beb90ea387b03788e4af5 fileType=PE32
executable (GUI) Intel 80386, for MS Windows


If you find any errors, bugs, mistakes or examples of wrong parsers, please let me know. It will help me develop this project further

@Kawron Kawron force-pushed the feat/ai-parser-creator branch from d734724 to 7d26272 Compare March 17, 2026 12:16
@ajasnosz ajasnosz changed the title Skill for parser creator feat: skill for parser creator Mar 25, 2026
@Kawron Kawron force-pushed the feat/ai-parser-creator branch from 43f81cb to 2fc909b Compare March 26, 2026 09:18
@Kawron Kawron marked this pull request as ready for review March 31, 2026 06:44
@Kawron Kawron requested a review from rjha-splunk as a code owner March 31, 2026 06:44
Base automatically changed from develop to main March 31, 2026 07:13
@ajasnosz ajasnosz changed the base branch from main to develop March 31, 2026 09:06
@Kawron Kawron force-pushed the feat/ai-parser-creator branch from 7723f8c to e2fef71 Compare March 31, 2026 10:22
@Kawron Kawron requested a review from ajasnosz April 2, 2026 08:18
epoch = epoch[:-7]
sendsingle(message, setup_sc4s[0], setup_sc4s[1][514])
st = env.from_string(
f'search index=netwaf sourcetype="a10networks:vThunder:cef" earliest={epoch}'
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

if we go the route of not specifying the name maybe here we also should change it

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

done

@Kawron Kawron requested a review from ajasnosz April 2, 2026 08:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants