SmartReduction
SmartReduction
This framework implements four distance based Big Data preprocessing algorithms for prototype selection and generation: FCNN_MR, SSMASFLSDE_MR, RMHC_MR, MR_DIS, with special emphasis in their scalability and performance traits.
Status
Use
Include this package in your Spark Applications using:
spark-shell, pyspark, or spark-submit
> $SPARK_HOME/bin/spark-shell --packages djgarcia:SmartReduction:1.0
sbt
If you use the sbt-spark-package plugin, in your sbt build file, add:
spDependencies += "djgarcia/SmartReduction:1.0"
Otherwise,
resolvers += "Spark Packages Repo" at "http://dl.bintray.com/spark-packages/maven" libraryDependencies += "djgarcia" % "SmartReduction" % "1.0"
Maven
In your pom.xml, add:
<dependencies> <!-- list of dependencies --> <dependency> <groupId>djgarcia</groupId> <artifactId>SmartReduction</artifactId> <version>1.0</version> </dependency> </dependencies> <repositories> <!-- list of other repositories --> <repository> <id>SparkPackagesRepo</id> <url>http://dl.bintray.com/spark-packages/maven</url> </repository> </repositories>
Release
The latest version is : 1.0 / Date: 2017-09-25 / Scala version: 2.11