Skip to content

Commit

Permalink
Merge branch 'hotfix/0.9.1'
Browse files Browse the repository at this point in the history
  • Loading branch information
juliencruz committed Jan 8, 2015
2 parents acb9290 + a6b267e commit 6009088
Show file tree
Hide file tree
Showing 16 changed files with 31 additions and 25 deletions.
26 changes: 16 additions & 10 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -8,12 +8,12 @@ such as Apache Storm easier, faster, and with "enterprise" like management funct
StreamFlow also provides a mechanism for non-developers such as data scientists, analysts, or
operational users to rapidly build scalable data flows and analytics.

StreamFlow provides the following capabilites:
StreamFlow provides the following capabilities:

1. A **responsive web interface** for building and monitoring Storm topologies.
2. An interactive **drag and drop topology builder** for authoring new topologies
3. A **dashboard** for monitoring the status and performance of topologies as well as viewing aggregated topology logs.
4. A speciaized **topology engine** which solves some Storm complexities such as ClassLoader isolation and serialization and provides a mechanism for dependency injection.
4. A specialized **topology engine** which solves some Storm complexities such as ClassLoader isolation and serialization and provides a mechanism for dependency injection.
5. A **modular framework** for publishing and organizing new capabilities in the form of Spouts and Bolts.


Expand All @@ -31,16 +31,16 @@ which is used to bootstrap and execute a topology along with StreamFlow specific

The following is a description of some core StreamFlow concepts and terminology.

##### Component
A component is either Storm Spout or a Storm Bolt
#### Component
Components represent business logic modules which are draggable in the StreamFlow UI. Examples of Components include Storm Spouts and Storm Bolts.

##### Framework
#### Framework
A grouping of related *Components* and their associated metadata. Ideally elements of a framework
should all be compatible when wired together on a topology as they share the same protocol.
Frameworks might be organized around a set of technologies or domains. An analogy would be a
Java Library or Objective C Framework. Topologies have frameworks as dependencies.

##### Resource
#### Resource
A resource is an object used by spouts/bolts in order to externalize common state. For example, an
object which represents a technical asset in the environment/cluster such as a database or Kafka
queue. Alternatively, a resource might provide an uploaded file or container of global state.
Expand All @@ -49,9 +49,11 @@ is used in several places in a topology or within multiple topologies. Resources
useful mechanism for injecting parameters, connections, or state into a bolt/spout making the spout
or bolt simpler, easier to write, and more testable.

##### Serialization
#### Serialization
Seriaizations allow for the definition of custorm serializers/deserializers. Specifically these serializations should be specified in the Kryo format to properly integrate with Storm.

##### Topology
#### Topology
Topologies in Storm define the processing logic and link between nodes to describe the data flow. StreamFlow utilizes registered components to allow users to dynamically build topologies in a drag and drop interface. This allows topologies to be built using existing components without requiring additional code.


## Find out more
Expand All @@ -72,7 +74,11 @@ Here are some quick links to help get you started with StreamFlow:


## Questions or need help?
Coming soon...

If you have any questions or issues please feel free to contact the development team using one of the following methods.

* [Google Group](https://groups.google.com/forum/#!forum/streamflow-user)
* [GitHub Issues](https://github.com/lmco/streamflow/issues)


## License
Expand All @@ -94,7 +100,7 @@ folder of this project.

## Documentation Version

*Last Updated: 11/16/2014*
*Last Updated: 1/7/2015*


[license]: http://www.apache.org/licenses/LICENSE-2.0
2 changes: 1 addition & 1 deletion pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,7 @@

<groupId>streamflow</groupId>
<artifactId>streamflow</artifactId>
<version>0.9.0</version>
<version>0.9.1</version>
<packaging>pom</packaging>

<name>StreamFlow</name>
Expand Down
2 changes: 1 addition & 1 deletion streamflow-core/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -22,7 +22,7 @@
<parent>
<groupId>streamflow</groupId>
<artifactId>streamflow</artifactId>
<version>0.9.0</version>
<version>0.9.1</version>
</parent>

<artifactId>streamflow-core</artifactId>
Expand Down
2 changes: 1 addition & 1 deletion streamflow-core/streamflow-datastore/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -22,7 +22,7 @@
<parent>
<groupId>streamflow</groupId>
<artifactId>streamflow-core</artifactId>
<version>0.9.0</version>
<version>0.9.1</version>
</parent>

<artifactId>streamflow-datastore</artifactId>
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -22,7 +22,7 @@
<parent>
<groupId>streamflow</groupId>
<artifactId>streamflow-datastore</artifactId>
<version>0.9.0</version>
<version>0.9.1</version>
</parent>

<artifactId>streamflow-datastore-core</artifactId>
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -22,7 +22,7 @@
<parent>
<groupId>streamflow</groupId>
<artifactId>streamflow-datastore</artifactId>
<version>0.9.0</version>
<version>0.9.1</version>
</parent>

<artifactId>streamflow-datastore-jdbc</artifactId>
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -22,7 +22,7 @@
<parent>
<groupId>streamflow</groupId>
<artifactId>streamflow-datastore</artifactId>
<version>0.9.0</version>
<version>0.9.1</version>
</parent>

<artifactId>streamflow-datastore-mongodb</artifactId>
Expand Down
2 changes: 1 addition & 1 deletion streamflow-core/streamflow-engine/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -22,7 +22,7 @@
<parent>
<groupId>streamflow</groupId>
<artifactId>streamflow-core</artifactId>
<version>0.9.0</version>
<version>0.9.1</version>
</parent>

<artifactId>streamflow-engine</artifactId>
Expand Down
2 changes: 1 addition & 1 deletion streamflow-core/streamflow-model/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -22,7 +22,7 @@
<parent>
<groupId>streamflow</groupId>
<artifactId>streamflow-core</artifactId>
<version>0.9.0</version>
<version>0.9.1</version>
</parent>

<artifactId>streamflow-model</artifactId>
Expand Down
2 changes: 1 addition & 1 deletion streamflow-core/streamflow-server/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -22,7 +22,7 @@
<parent>
<groupId>streamflow</groupId>
<artifactId>streamflow-core</artifactId>
<version>0.9.0</version>
<version>0.9.1</version>
</parent>

<artifactId>streamflow-server</artifactId>
Expand Down
2 changes: 1 addition & 1 deletion streamflow-core/streamflow-service/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -22,7 +22,7 @@
<parent>
<groupId>streamflow</groupId>
<artifactId>streamflow-core</artifactId>
<version>0.9.0</version>
<version>0.9.1</version>
</parent>

<artifactId>streamflow-service</artifactId>
Expand Down
2 changes: 1 addition & 1 deletion streamflow-core/streamflow-util/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -22,7 +22,7 @@
<parent>
<groupId>streamflow</groupId>
<artifactId>streamflow-core</artifactId>
<version>0.9.0</version>
<version>0.9.1</version>
</parent>

<artifactId>streamflow-util</artifactId>
Expand Down
2 changes: 1 addition & 1 deletion streamflow-dist/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -22,7 +22,7 @@
<parent>
<groupId>streamflow</groupId>
<artifactId>streamflow</artifactId>
<version>0.9.0</version>
<version>0.9.1</version>
</parent>

<artifactId>streamflow-dist</artifactId>
Expand Down
2 changes: 1 addition & 1 deletion streamflow-frameworks/core-framework/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -22,7 +22,7 @@
<parent>
<groupId>streamflow</groupId>
<artifactId>streamflow-frameworks</artifactId>
<version>0.9.0</version>
<version>0.9.1</version>
</parent>

<artifactId>core-framework</artifactId>
Expand Down
2 changes: 1 addition & 1 deletion streamflow-frameworks/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -22,7 +22,7 @@
<parent>
<groupId>streamflow</groupId>
<artifactId>streamflow</artifactId>
<version>0.9.0</version>
<version>0.9.1</version>
</parent>

<artifactId>streamflow-frameworks</artifactId>
Expand Down
2 changes: 1 addition & 1 deletion streamflow-frameworks/twitter-framework/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -22,7 +22,7 @@
<parent>
<groupId>streamflow</groupId>
<artifactId>streamflow-frameworks</artifactId>
<version>0.9.0</version>
<version>0.9.1</version>
</parent>

<artifactId>twitter-framework</artifactId>
Expand Down

0 comments on commit 6009088

Please sign in to comment.