Apache Ignite Hadoop Accelerator provides a set of components allowing for in-memory Hadoop job execution and file system operations.
Hadoop Accelerator ships with alternate high-performant implementation of job tracker which replaces standard Hadoop MapReduce. Use it to boost your Hadoop MapReduce job execution performance.
Hadoop Accelerator ships with an implementation of Hadoop
FileSystem which stores file system data in-memory using distributed Ignite File System (
IGFS). Use it to minimize disk IO and improve performance of any file system operations.
Hadoop Accelerator ships with an implementation of
SecondaryFileSystem. This implementation can be injected into existing IGFS allowing for read-through and write-through behavior over any other Hadoop
FileSystem implementation (e.g.
HDFS). Use it if you want your
IGFS to become an in-memory caching layer over disk-based
HDFS or any other Hadoop-compliant file system.
Updated about 10 hours ago