This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision | ||
bigdata [2019/09/12 12:36] mantis [SimpliLearn] |
bigdata [2020/07/13 13:39] (current) mantis |
||
---|---|---|---|
Line 14: | Line 14: | ||
Implementation examples for [[https://dzone.com/articles/kafka-producer-and-consumer-example|Producers and Consumers]], [[https://dzone.com/articles/live-dashboard-using-apache-kafka-and-spring-webso|Kafka with Spring WebSockets]]. | Implementation examples for [[https://dzone.com/articles/kafka-producer-and-consumer-example|Producers and Consumers]], [[https://dzone.com/articles/live-dashboard-using-apache-kafka-and-spring-webso|Kafka with Spring WebSockets]]. | ||
+ | |||
+ | ====== Apache Storm ====== | ||
+ | |||
+ | [[https://storm.apache.org/|Storm]] | ||
+ | |||
====== Apache Flume ====== | ====== Apache Flume ====== | ||
Line 162: | Line 167: | ||
[[https://developer.ibm.com/hadoop/2017/01/06/start-flume-agents-using-ambari-web-interface/|Flume in Ambari]] | [[https://developer.ibm.com/hadoop/2017/01/06/start-flume-agents-using-ambari-web-interface/|Flume in Ambari]] | ||
- | ====== Apache Storm ====== | + | |
Line 178: | Line 183: | ||
* use a small subset of your data | * use a small subset of your data | ||
* use --run-mode local | * use --run-mode local | ||
+ | * enable debugging in conf/log4j.properties <code>org.locationtech.geomesa.convert=debug </code> | ||
* set the error mode to 'raise-errors' in the converter options: https://www.geomesa.org/documentation/user/convert/parsing_and_validation.html#error-mode | * set the error mode to 'raise-errors' in the converter options: https://www.geomesa.org/documentation/user/convert/parsing_and_validation.html#error-mode | ||
Line 296: | Line 302: | ||
hdfs-audit.log files | hdfs-audit.log files | ||
+ | |||
+ | |||
+ | |||
+ | ====== Clouds ====== | ||
+ | |||
+ | https://aws.amazon.com/pricing/ | ||
+ | |||
+ | https://www.cloudera.com/products/pricing.html | ||
+ | |||
+ | https://azure.microsoft.com/en-us/pricing/ | ||
+ | |||
Line 314: | Line 331: | ||
[[https://www.cloudera.com/about/training/courses/hdp-spark-developer.html#?classType=virtual|HDP Spark Developer DEV-343]] | [[https://www.cloudera.com/about/training/courses/hdp-spark-developer.html#?classType=virtual|HDP Spark Developer DEV-343]] | ||
+ | |||
+ | DataFrames/DataSets/RDD, shuffling, transformations and performance tuning, streaming | ||
* dataOps, analysts | * dataOps, analysts | ||
Line 350: | Line 369: | ||
https://academy.databricks.com/catalog | https://academy.databricks.com/catalog | ||
+ | [[https://academy.databricks.com/instructor-led-training/DB301|DB 301 - Apache Spark™ for Machine Learning and Data Science]] | ||
+ | * 3 days | ||
+ | * virtual classroom | ||
+ | * $2500 | ||
+ | short, self-paced courses based on AWS or Azure: $75 | ||
+ | [[https://academy.databricks.com/category/certifications|certifications]] | ||
===== Dell ===== | ===== Dell ===== | ||
Line 403: | Line 428: | ||
https://www.meetup.com/Wien-Cloud-Computing-Meetup/ | https://www.meetup.com/Wien-Cloud-Computing-Meetup/ | ||
- | https://viennadatasciencegroup.at/category/events/ | + | https://www.meetup.com/Big-Data-Vienna/ |
+ | |||
+ | https://www.meetup.com/Vienna-Data-Science-Group-Meetup/ | ||
https://www.ocg.at/cloud-computing-big-data | https://www.ocg.at/cloud-computing-big-data | ||