To integrate StatsD and Amazon Streams with your monitoring system, please reach out to MetricFire. Book a demo with the MetricFire team to discuss integrating StatsD and Amazon Streams and how that can support your monitoring system.
StatsD is a network daemon that runs on the Node.js platform and listens for statistics, like counters and timers. StatsD sends this information over UDP or TCP from your server or network to your monitoring server. In most cases, your StatsD will send aggregates to one or more pluggable backend services (e.g., Graphite).
StatsD is considered a “collector” in the monitoring world. It’s key job is to find and pull the metrics from your systems, and then push them to a monitoring server. However, it doesn’t store, aggregate, visualize or alert on any of your metrics. StatsD is intended for only one use-case: collecting.
The key benefit of using StatsD is the customizability. Unlike standard Agents, you can tailor StatsD to do exactly what you want. You can map out hundreds of metrics, give the metrics customized names, and have them sent into your monitoring backend.
Typically, StatsD pairs with Graphite as the monitoring backend. The primary reason for this is that Graphite does not come with its own collector.
However, StatsD is also often used to pull metrics in unique or challenging cases, when something like a typical monitoring agent, or Prometheus’ built-in metrics scraping tool isn’t able to collect what you’re looking for. For example, StatsD is often used for monitoring Python web apps with Prometheus.
StatsD can be used to pull metrics from every part of the service that is running, and enables this data to be easily summed to get a clear picture of what your data is doing.
StatsD is also used to combine metrics from multiple sources into one location, such as pulling Graphite metrics into Prometheus.
At MetricFire, you can integrate with StatsD using MetricFire’s StatsD Add-on. You can automatically pull your StatsD metrics into our monitoring platform, and see your StatsD metrics alongside your AWS and Graphite monitoring.
Amazon Kinesis Data Streams (KDS) is a data streaming service that is both scalable and durable and operates in real-time. It can capture gigabytes of data-per-second from hundreds of thousands of sources, including websites, databases, social media feeds, IT logs, financial transactions, and location-tracking events. Real-time analytics tools such as dashboards, anomaly detection, and dynamic pricing are updated in milliseconds.
KDS is based around a producer/consumer model. A producer loads data records into Amazon KDS. A consumer then processes the data records from the stream. For example, a producer could load web server log data to a Kinesis data stream, where a consumer can process and analyze the log data.
You can use Kinesis Data Streams to collect log and event data from servers, desktops, and mobile devices. You can then build Kinesis Applications to process your data continuously, generate metrics, populate dashboards, and aggregate data into stores such as Amazon S3.
You can create Kinesis Applications that run real-time analytics on high-frequency event data events. For example, you could write an application to analyze sensor data collected by Kinesis Data Streams to gain insights into your sensor data.
If you collect gaming data, Kinesis Data Streams can collect data about player-game interactions and feed the data back into your gaming platform. This strategy can help you design a game that provides engaging and dynamic experiences based on players' past actions and behaviors.
With Metricfire, you can turbocharge your data stream monitoring services. By integrating Amazon CloudWatch with the Metricfire platform, you can display your KDS metrics on aesthetically pleasing dashboards. MetricFire's advanced filtering lets you choose only the data views you want to see and discard the rest. You can also set up simple rules to discard data you no longer keep, plus receive alerts via email or Slack when your data streams are doing something they shouldn't.
MetricFire is a full-scale platform that provides infrastructure, system, and application monitoring using a suite of open-source monitoring tools. We enable you to use Hosted Graphite and aesthetic custom dashboards to visualize your metrics so you can understand what is happening.
MetricFire offers users a complete ecosystem of end-to-end infrastructure monitoring, comprised of popular open-source monitoring software services: Graphite and popular dashboards. Plugins for many other open-source projects are preconfigured, such as StatsD, collectd, and Kubernetes. You get all these within a hosted environment as a single product. Not only does MetricFire fit well into the infrastructure monitoring use-case, such as network monitoring and server monitoring, but we also do application monitoring and business intelligence.
Through this hosted environment, MetricFire boosts the unique features of open-source projects to give you more functionality than the original products. Below are some of the MetricFire features at a glance:
The key thing to remember is that Hosted Graphite by MetricFire is more than just Graphite. Our Hosted Graphite product actually adds data dimensionality and better data storage.
The benefits of MetricFire are:
Why thousands of engineers choose us:
Vendor lock-in's not our thing. We’re believers in you still owning your data, so you can request a full export at any time. That means you get all the benefits of an open-source tool, but with the security and stability of a SaaS tool.
“We now have over ten times the amount of metrics we started with, and on different accounts. One of the great things about MetricFire is that scaling to support this increase has been hassle-free, requiring no additional work on our side.”
Maxime Audet, Cloud-Ops Team Lead, CoveoRead customer story
Save valuable engineering time and stick within your budget. We're known for our predictable and transparent pricing so it's easy to keeps costs under control.
“Building and managing an on-premise installation at this scale would require a lot of engineer time, especially in the first year...we use this engineering time to work on initiatives closer to our core business”
Jim Davies, Head of DevOps, MoneySuperMarket.comRead customer story
Transparency is at the root of how we operate: from pricing to postmortems we're open about how we do things. We even publish our internal system metrics to our public status page.
“There’s complete transparency with everything MetricFire do which means we can accurately predict what we’ll be spending and comfortably keep within our budget.”
Itai Yaffe, Big Data Developer, NielsenRead customer story
Our first line, technical support comes from engineers, for engineers. So you get highly detailed, expert support when you need it.
"Every time I have a question, I get an answer from support after just a couple of hours. Their technical knowledge is excellent.”
Shahar Kobrinsky, VP of Architecture and Scale, EyeviewRead customer story