Monitoring Amazon Streams with Graphite APIs

To integrate Amazon Streams and Graphite APIs with your monitoring system, please reach out to MetricFire. Book a demo with the MetricFire team to discuss integrating Amazon Streams and Graphite APIs and how that can support your monitoring system.

Amazon Kinesis Data Streams (KDS) is a data streaming service that is both scalable and durable and operates in real-time. It can capture gigabytes of data-per-second from hundreds of thousands of sources, including websites, databases, social media feeds, IT logs, financial transactions, and location-tracking events. Real-time analytics tools such as dashboards, anomaly detection, and dynamic pricing are updated in milliseconds.

KDS is based around a producer/consumer model. A producer loads data records into Amazon KDS. A consumer then processes the data records from the stream. For example, a producer could load web server log data to a Kinesis data stream, where a consumer can process and analyze the log data.

You can use Kinesis Data Streams to collect log and event data from servers, desktops, and mobile devices. You can then build Kinesis Applications to process your data continuously, generate metrics, populate dashboards, and aggregate data into stores such as Amazon S3.

You can create Kinesis Applications that run real-time analytics on high-frequency event data events. For example, you could write an application to analyze sensor data collected by Kinesis Data Streams to gain insights into your sensor data.

If you collect gaming data, Kinesis Data Streams can collect data about player-game interactions and feed the data back into your gaming platform. This strategy can help you design a game that provides engaging and dynamic experiences based on players' past actions and behaviors.

With Metricfire, you can turbocharge your data stream monitoring services. By integrating Amazon CloudWatch with the Metricfire platform, you can display your KDS metrics on aesthetically pleasing dashboards. MetricFire's advanced filtering lets you choose only the data views you want to see and discard the rest. You can also set up simple rules to discard data you no longer keep, plus receive alerts via email or Slack when your data streams are doing something they shouldn't.

Graphite-API is a tool designed to fetch metrics from time series databases such as Whisper or Cyanite. Once it has gathered the metrics, it then renders graphs or JSON data out of each of these time series. Graphite-API is an API-based alternative to Graphite-web, so it does not have any built-in dashboard. Instead, this AP server tool replicates Graphite-web behavior, and works with the abundant Graphite dashboard applications available on the market such as Grafana.

The Graphite-API application comes with several improvements over Graphite-web:

• The Graphite-API application is entirely stateless and doesn't require a SQL database to function.
• It supports both Python 2 and 3.
• The HTTP API accepts JSON data and allows the formation of data and query string parameters.
• The application is straightforward for the user to install and configure.
• Graphite-API architecture is simpler, almost minimalistic, and it has fewer moving parts than Graphite-web.
• It comes with a plugin architecture for integrating with time series databases or for adding more analysis functions.
• The API codebase has a stronger focus on test coverage and code quality.

Graphite API does not come with any web or graphical interfaces. This feature gap is where MetricFire comes into its own.

With our Hosted Graphite solution, we've taken the best parts of open-source Graphite and supercharged them. We also added everything missing in Graphite: a built-in agent, team accounts, granular dashboard permissions, and integrations with other technologies and services like AWS, Heroku, logging tools, and more. Hosted Graphite's advanced filtering lets you choose only the data views you want to see, so you can discard the rest. You can also set up simple rules to discard data you no longer keep, plus receive alerts via email or the Slack messaging platform.

To integrate Amazon Streams and Graphite APIs with your monitoring system, sign up for a free trial with MetricFire. Talk with the MetricFire team about how to integrate Amazon Streams and Graphite APIs and get Amazon Streams and Graphite APIs interacting with your MetricFire dashboards directly.

MetricFire is a full-scale platform that provides infrastructure, system, and application monitoring using a suite of open-source monitoring tools. We enable you to use Hosted Graphite and aesthetic custom dashboards to visualize your metrics so you can understand what is happening.

MetricFire offers users a complete ecosystem of end-to-end infrastructure monitoring, comprised of popular open-source monitoring software services: Graphite and popular dashboards. Plugins for many other open-source projects are preconfigured, such as StatsD, collectd, and Kubernetes. You get all these within a hosted environment as a single product. Not only does MetricFire fit well into the infrastructure monitoring use-case, such as network monitoring and server monitoring, but we also do application monitoring and business intelligence.

Through this hosted environment, MetricFire boosts the unique features of open-source projects to give you more functionality than the original products. Below are some of the MetricFire features at a glance: 

Cloud Monitoring

Hosted Graphite

Dashboards

The key thing to remember is that Hosted Graphite by MetricFire is more than just Graphite. Our Hosted Graphite product actually adds data dimensionality and better data storage.

The benefits of MetricFire are:

Simple, low-cost pricing
A structured pricing model based on unique time series metrics allows you to work within your budget. The predictability and transparent pricing allow you to keep your costs in check and plan for the future. 1 metric is 1 metric.

Easy-to-use dashboards
Easily share your dashboards with clients for free.

Responsive alerting
Alert notification integrations PagerDuty, Slack, email, and webhooks.

Freedom of customization
Custom metrics through your code.

Fantastic customer support
Highly available support is provided by engineers for engineers to get you set up quickly.

Enterprise-ready
Dedicated clusters for users that need their own environment.