Release ida pro binexport plugin(former binnavy)

Storm Shadow

Administrator
Staff member
Developer
Ida Pro Expert
Elite Cracker
Google who bought Binnavy release the rest of the binnavy !



BinExport


Copyright 2011-2016 Google Inc.
Disclaimer: This is not an official Google product (experimental or otherwise), it is just code that happens to be owned by Google.
Introduction

BinExport is the exporter component of the BinNavi project. It is a plugin for the commercial IDA Pro disassembler and exports disassemblies into the PostgreSQL database format that BinNavi requires. A previous version (zynamics_binexport_8) also ships with BinDiff, serving a similar purpose.
This repository contains the complete source code necessary to build the IDA Pro plugin for Linux, Windows and OS X.
Installation

Download the binaries from the release page and copy them into the IDA Pro plugins directory. These are the default paths:
OS Plugin path
Linux /opt/ida-6.9/plugins
OS X /Applications/IDA Pro 6.9/idabin/plugins
Windows %ProgramFiles(x86)%\IDA 6.9\plugins
Note (Windows only): Due to the way the BinExport build works currently, you also have to copy the PostgreSQL client libray and SSL libraries to the IDA installation directory. See The "Build BinExport" section below.
Usage

The main use case is via BinNavi. However, BinExport can also be used to export IDA Pro disassembly to files of various formats:
  • Protocol Buffer based full export
  • Statistics text file
  • Text format for debugging
  • BinNavi database export into a PostgreSQL database
Invocation

Via the UI

  1. Open an IDB
  2. Select Edit|Plugins|BinExport 9
  3. The following dialog box appears:
  4. Select the type of the file to be exported
Note: There is no UI for the database export.
IDC Scripting

The BinExport plugin registers the IDC functions below. The function names are versioned in order to support side-by-side installation of different versions (i.e. BinDiff's BinExport 8).
IDC Function name Exports to Arguments
BinExport2Sql9 PostgreSQL database host, port, database, schema, user, password
BinExport2Diff9 Protocol Buffer filename
BinExport2Text9 Text file dump filename
BinExport2Statistics9 Statistics text file filename
BinExport also supports exporting to a database via the RunPlugin() IDC function:
static main() {
Batch(0);
Wait();
RunPlugin("zynamics_binexport_9", 1);
Exit(0);
}

Use the plugin options listed below to setup the database connection in that case. See also the CBinExportImporter class in BinNavi.
Plugin Options

BinExport defines the following plugin options, that can be specified on IDA's command line:
Option Description
-OExporterHost:<HOST> Database server to connect to
-OExporterPort:<PORT> Port to connect to. PostgreSQL default is 5432.
-OExporterUser:<USER> User name
-OExporterPassword:<PASS> Password
-OExporterDatabase:<DB> Database to use
-OExporterSchema:<SCHEMA> Database schema. BinNavi only uses "public".
-OExporterLogFile:<FILE> Log messages to a file
-OExporterAlsoLogToStdErr:TRUE If specified, also log to standard error
How to build

Preparing the build environment

As we support exporting into PostgreSQL databases as well as a Protocol Buffer based format, there are quite a few dependencies to satisfy:
  • Boost 1.55.0 or higher (a partial copy ships in third_party/boost_parts)
  • CMake 2.8.11 or higher
  • GCC 4.8 or a recent version of Clang
  • Git 1.8 or higher
  • IDA SDK 6.9 (unpack into third_party/idasdk)
  • OpenSSL 1.0.1 or higher (checked out as a sub-module)
  • Perl 5.6 or higher
  • PostgreSQL client libraries 9.3 or higher
  • Protocol Buffers 3.0.0 beta 2 or higher (checked out as a sub-module)
Linux

Prerequisites

The preferred build environment is Ubuntu 14.04 LTS (64-bit Intel).
This should install all the necessary packages:
sudo dpkg --add-architecture i386
sudo add-apt-repository ppa:ubuntu-toolchain-r/test -y
sudo apt-get update -qq
sudo apt-get install -qq --no-install-recommends \
build-essential cmake \
g++-4.8:amd64 g++:amd64 lib32stdc++-4.8-dev \
libpq-dev:i386 libpq5:i386 krb5-multidev:i386
export CXX="g++-4.8" CC="gcc-4.8"

The following sections assume that your current working directory is at the root of the cloned repository.
Initialize the submodules in the third_party directory:
git submodule update --init --recursive

IDA SDK

Unzip the contents of the IDA SDK into third_party/idasdk. Shown commands are for IDA 6.9:
unzip PATH/TO/idasdk69.zip -d third_party/idasdk
mv third_party/idasdk/idasdk69/* third_party/idasdk
rmdir third_party/idasdk/idasdk69

OpenSSL

Configure and build 32-bit static libraries of OpenSSL:
cd third_party/openssl
./Configure no-asm no-dso no-krb5 no-shared no-zlib linux-generic32 -m32
make -s -j$(nproc)
cd ../..

Using the distribution packages of OpenSSL

You may skip the above and install the libssl-dev:i386 package. If you do that, you also need to adjust the paths of the OpenSSL libraries when configuring the source:
...
-DOPENSSL_CRYPTO_LIBRARY=/usr/lib/i386-linux-gnu/libcrypto.a \
-DOPENSSL_SSL_LIBRARY=/usr/lib/i386-linux-gnu/libssl.a \
...

Protocol Buffers

Configure and build 32-bit static libraries of Protocol Buffers. This will also build the compiler, protoc:
cd third_party/protobuf
./autogen.sh && ./configure CFLAGS=-m32 CXXFLAGS=-m32 LDFLAGS=-m32 \
--disable-dependency-tracking \
--disable-maintainer-mode \
--enable-silent-rules
make -s -j$(nproc)
cd ../..

Note that this will download Google Mock if not already present in third_party/protobuf/gmock.
Build BinExport

With all prerequisites in place, configure and build BinExport:
./configure \
-DOPENSSL_ROOT_DIR=${PWD}/third_party/openssl
make

Note: If you chose use the distribution packages of OpenSSL, add the additional flags mentioned above.
If all went well, the source tree should contain two IDA plugin binaries zynamics_binexport_9.plx and zynamics_binexport_9.plx64 for use with idaq and idaq64, respectively.
Mac OS X

Prerequisites

The preferred build environment is Mac OS X 10.11.3 "El Capitan" (64-bit Intel) using Xcode 7.2.1.
After installing the Developer Tools, make sure to install the command-line tools:
sudo xcode-select --install

Recent versions of the Developer Tools no longer include GNU Autotools. You can install those via Homebrew (recommended) or via MacPorts. Follow the installation instructions on the respective websites.
For Homebrew:
brew install autoconf automake libtool

For MacPorts:
sudo /opt/local/bin/port install autoconf automake libtool

The following sections assume that your current working directory is at the root of the cloned repository.
Initialize the submodules in the third_party directory:
git submodule update --init --recursive

CMake

Download the latest stable version of CMake from the official site and mount its disk image:
curl -L https://cmake.org/files/v3.4/cmake-3.4.3-Darwin-x86_64.dmg \
-o $HOME/Downloads/cmake-osx.dmg
hdiutil attach $HOME/Downloads/cmake-osx.dmg

At this point you will need to review and accept CMake's license agreement. Now install CMake:
sudo cp -Rf /Volumes/cmake-3.4.3-Darwin-x86_64/CMake.app /Applications/
hdiutil detach /Volumes/cmake-3.4.3-Darwin-x86_64
sudo /Applications/CMake.app/Contents/bin/cmake-gui --install

The last command makes CMake available in the system path.
IDA SDK

Unzip the contents of the IDA SDK into third_party/idasdk. Shown commands are for IDA 6.9:
unzip PATH/TO/idasdk69.zip -d third_party/idasdk
mv third_party/idasdk/idasdk69/* third_party/idasdk
rmdir third_party/idasdk/idasdk69

OpenSSL

Configure and build 32-bit static libraries of OpenSSL:
cd third_party/openssl
./Configure no-asm no-zlib darwin-i386-cc
make -s -j$(sysctl -n hw.ncpu)
cd ../..

Warnings about object files in libcrypto.a having no symbols can safely be ignored.
Using the Developer Tools' version of OpenSSL

You can skip the above and link against the version of OpenSSL that ships with Apple's Developer Tools. This is not recommended, however, since that version is quite old (0.9.8).
PostgreSQL client libraries

The OS X Developer Tools actually ship with a version of the PostgreSQL client libraries. However, these were only built for 64-bit and so cannot be used for building the BinExport plugin (which, because of IDA Pro, is always 32-bit).
Download the official packages and do an unattended installation of PostgreSQL. Unfortunately there is no ready-made package for just the client libraries, so this installs a full database server.
curl -L http://get.enterprisedb.com/postgresql/postgresql-9.3.11-1-osx.dmg \
-o $HOME/Downloads/postgresql-osx.dmg
hdiutil attach $HOME/Downloads/postgresql-osx.dmg
sudo /Volumes/PostgreSQL\ 9.3.11-1/postgresql-9.3.11-1-osx.app/Contents/MacOS/osx-intel \
--mode unattended --unattendedmodeui none \
--disable-stackbuilder 1 --create_shortcuts 0
hdiutil detach /Volumes/PostgreSQL\ 9.3.11-1

Optional: Remove the "postgres" user, if running a full PostgreSQL instance on the local machine is not desired:
sudo dscl . -delete /Users/postgres

Note: You can also download the PostgreSQL source code and build the client libraries manually.
Protocol Buffers

Configure and build 32-bit static libraries of Protocol Buffers. This will also build the compiler, protoc:
cd third_party/protobuf
./autogen.sh && ./configure CFLAGS=-m32 CXXFLAGS=-m32 LDFLAGS=-m32 \
--disable-dependency-tracking \
--disable-maintainer-mode \
--enable-silent-rules
make -s -j$(sysctl -n hw.ncpu)
cd ../..

Note that this will download Google Mock if not already present in third_party/protobuf/gmock.
Build BinExport

With all prerequisites in place, configure and build BinExport:
./configure \
-DOPENSSL_ROOT_DIR=${PWD}/third_party/openssl \
-DPostgreSQL_INCLUDE_DIR=/Library/PostgreSQL/9.3/include \
-DPostgreSQL_LIBRARY=/Library/PostgreSQL/9.3/lib/libpq.a \
-DOPENSSL_LIBRARIES=third_party/openssl/libssl.a:third_party/openssl/libcrypto.a
make

Note: If you chose to use the distribution packages of OpenSSL, add the additional flags mentioned above.
If all went well, the source tree should contain two IDA plugin binaries zynamics_binexport_9.pmc and zynamics_binexport_9.pmc64 for use with idaq and idaq64, respectively.
Windows

The preferred build environment is Windows 8.1 (64-bit Intel) using the Visual Studio 2013 compiler and the Windows SDK for Windows 8.1.
CMake

Download and install CMake from its download page. Make sure to select "Add CMake to the system PATH for all users".
Git

Download and install Git from its download page. Make sure to select the following options:
  • Set installation directory should be left at the default %ProgramFiles%\Git\bin\git.exe
  • "Use Git from the Windows Command Prompt" - have the setup utility add Git to your system path.
  • "Use Windows' default console window" - to be able to use Git from the regular command prompt.
Perl

Download and install ActiveState Perl from its download page. This should add Perl to the system path.
Prepare

The following sections assume an open command prompt with the current working directory located at the root of the cloned BinExport repository:
git clone https://github.com/google/binexport.git
cd binexport

Initialize the submodules in the third_party directory:
git submodule update --init --recursive

Make the Visual Studio compiler and build tools available:
call "%VS120COMNTOOLS%\..\..\VC\vcvarsall.bat" x86

IDA SDK

Unzip the contents of the IDA SDK into third_party/idasdk. Shown commands are for IDA 6.9, assuming that Git was installed into the default directory first:
"%ProgramFiles%\Git\usr\bin\unzip" PATH\TO\idasdk69.zip -d third_party
rename third_party\idasdk69 idasdk

OpenSSL

Configure and build 32-bit static libraries of OpenSSL:
cd third_party\openssl
perl Configure VC-WIN32 no-asm
call ms\do_ms
nmake /f ms\nt.mak
mklink /J lib out32
cd ..\..

PostgreSQL client libraries

Download the PostgreSQL binary zip file distribution from its download page. Select the "Win x86-32" package version 9.3.11.
Then extract it to third_party\pgsql, again using the version of the unzip utility that ships with Git:
"%ProgramFiles%\Git\usr\bin\unzip" PATH\TO\postgresql-9.3.11-1-windows-binaries.zip -d third_party

Protocol Buffers

Configure and build 32-bit static libraries of Protocol Buffers. This will also build the compiler, protoc.exe:
cd third_party\protobuf
mkdir build_msvc
cd build_msvc
cmake ^
-G "Visual Studio 12" ^
-Dprotobuf_BUILD_SHARED_LIBS=OFF ^
-DCMAKE_BUILD_TYPE=Release ^
-Dprotobuf_BUILD_TESTS=OFF ^
..\cmake
msbuild protobuf.sln /p:platform=Win32 /p:Configuration=Release
cd ..\..\..

Build BinExport

With all prerequisites in place, configure and build BinExport:
mklink /J third_party\zynamics\binexport .
mkdir build_msvc
cd build_msvc
cmake ^
-DCMAKE_BUILD_TYPE=Release ^
-DGIT_EXECUTABLE="%ProgramFiles%\Git\bin\git.exe" ^
-DOPENSSL_ROOT_DIR="%cd%\..\third_party\openssl" ^
-DOPENSSL_USE_STATIC_LIBS=TRUE ^
-DOPENSSL_INCLUDE_DIR="%cd%\..\third_party\openssl\inc32" ^
-DPostgreSQL_ROOT="%cd%\..\third_party\pgsql" ^
..
msbuild binexport.sln /p:platform=Win32 /p:Configuration=Release

If all went well, the build_msvc directory should contain two IDA plugin binaries zynamics_binexport_9.plw and zynamics_binexport_9.p64 for use with idaq.exe and idaq64.exe, respectively.
Note that in order to use the plugins, you need to copy the following files to the IDA Pro installation directory (%ProgramFiles(x86)%\IDA 6.9 by default):
  • libeay32.dll
  • libintl.dll
  • libpq.dll
  • ssleay32.dll
The alternative would be to build a static PostgreSQL client library from source.

Download at github

https://github.com/google/binexport
 
Top