format-reversing.md

Awesome Data Format Reverse Engineering

A curated list of awesome reverse engineering resources to make you better!

Managed by Reversing.ID for the reversing community.

Introduction

Data Format Reverse Engineering focus on representation and interpretation of structured data in stored or transmitted form.

In some cases, format reversing is done in conjunction with software which generate the data.

Most common usage of format reversing is reverse engineering the game assets, which is stored in specializedd containers or undocumented formats for models, textures, animations, audio, etc.

Table of Contents

• Resources
  • Forums & Communities
  • Articles
  • Tutorials
  • Practices
  • References
• Tools
  • Hex Editors
  • Format Identifier
  • Structure Parser
  • Binary Visualization
  • String Search
  • Pattern Search
  • Bundle Extractor

---

Forums & Communities

Game hacking and reverse engineering

• ZenHAX - game hacking and reversing forum
• ResHAX - game reversing archives and formats
• XeNTaX Forum - game archive and format research forum
• REGames - discord server for game reversing and file format research
• The VG Resource - discord server for the VG Resource asset database (models, textures, sprites, sounds, etc)

• The Cutting Room Floor (TCRF) - discord server for discovering and documenting unused and debug game content

Articles

Generic

• How to crack a Binary File Format - classic tutorial on reverse engineering file formats

Game asset

• DGTEFF - The Definitive Guide to Exploring File Formats
• Compression Deep Dive
• How to grab models and textures - guide on extracting models and textures from games

Tutorials

• Binary File Format Engineering and Reverse Engineering - Peter Bindels - ACCU 2023 conference talks on binary file format analysis and reverse engineering techniques
• Reverse Engineering Game Formats for Fun and Profit - Spencer Alves - Con West 2020 talk on reverse engineering game file formats

Practices

Game files reversing practices

• kovidomi/game-reversing - beginner learning materials on reverse engineering video games

References

knowledge bases & format databases for game

• ArchiveTeam's wiki

• XeNTaX Wiki

---

Hex Editors

Hex editor lets you view/edit the binary data of a file.

Multi/cross platform

• 010 Editor
• Kaitai Struct
• wxHexEditor

Windows

• HxD
• Hex Workshop
• Hexinator

Mac OS X

• HexFiend

Format Identifier

• Binwalk

Structure Parser

• 010 Editor
• ImHex
• Kaitai Struct

Binary Visualization

• Veles
• ..cantor.dust..
• binglide

String Search

• bingrep - grep through binaries

Pattern Search

• YARA

Extractor

Archive extractor

• QuickBMS - easily extract and modify file format with support of encryption, compressions, obfuscation, and other algorithms.

Game assets or bundle extractor

• UABE - Unity Assets Bundle Extractor
• DevXUnityUnpacker
• MultiEx Commander - multiple game resources archive.
• isodump - PlayStation ISO content extraction tool.
• UnkrawerterGBA - GBA ROM extractor and converter for games using the Krawall Sound Engine
• wad-tools - WAD archive format (Wii/GameCube) extractor.
• mymc - importing/exporting save games in MAX Drive (.max) and EMS (.psu) formats for PlayStation 2 memory card images.