To integrate collectd and Amazon EC2 with your monitoring system, reach out to MetricFire. Book a demo with the MetricFire team to discuss integrating collectd and Amazon EC2 and how that can support your monitoring system.
Collectd is system statistics collection daemon that periodically retrieves system and application performance metrics and then stores them using various storage solutions such as RRD files. Collectd is a free open-source project. It can gather metrics from multiple sources, including operating systems, applications, log files, and external devices. You can use the statistics compiled by collectd to monitor systems, detect performance bottlenecks, and predict future system loads.
Because it's written in C, collectd is built for performance and portability, allowing you to run it on systems with no scripting language or an embedded system. It comes with optimizations and features to handle hundreds of thousands of metrics. Collectd also lets you configure what metrics you want to capture and what frequency you want to capture them, allowing you to scale back your metrics collection collect only the metrics that make sense for your business needs. Its modular architecture allows the daemon to use only the resources required to do the job.
Collectd only performs the collection and transmission of the metrics. It does not analyze or present the metrics on its own. But by integrating collectd with the Metricfire platform, you can enjoy metrics displayed on aesthetically pleasing dashboards. Our integration lets you view metrics on essential systems and application log messages on your Hosted Graphite graphs and dashboards.
You can download a collectd configuration file pre-filled with your Hosted Graphite account details on our add-ons page. This configuration comes with several collectd plugins enabled, including CPU, DF (file system usage), disk, entropy, interface, load, memory, processes, rrdtool, swap, users and write_graphite.
Amazon EC2 (Elastic Compute Cloud) is a web service provided by AWS and offers users the ability to run applications on the public cloud. Users and businesses can rent virtual computers, otherwise known as "Instances", in order to provide secure, resizable compute capacity in the cloud. By using Amazon EC2, it eliminates the need to buy hardware upfront, so you can focus more on developing and deploying applications quicker. Amazon EC2 also allows you to launch as many (or few) virtual servers as you need, manage your storage, and configure your security and networking. To reduce your need to forecast traffic, Amazon EC2 lets you scale up or down to handle potential changes in requirements or spikes in popularity.
Instances are made up of different operating systems and resource configurations, including CPU processing power, memory, networking, and storage. These instances are available as a selection of pre-configured environments users can choose from. The Amazon EC2 model is arguably the deepest and broadest global cloud computing model. As AWS states, Amazon EC2 offers the "fastest processors in the cloud" and are the "only cloud with 400 Gbps ethernet networking".
Amazon EC2 instances produce raw data and statistics on the state of its processes, performance. and health. Data is sent every 5 minutes by default, or can be configured to send every minute if detailed monitoring is enabled. This data is collected by Amazon CloudWatch, which can be integrated into the EC2 suite. It is then processed into readable, near real-time metrics. There are options in which these metrics are then displayed using easy to read graphs, and one is directly from the EC2 console. Another is to integrate Amazon CloudWatch with MetricFire.
With Metricfire, you can turbocharge your Amazon EC2 monitoring services. By integrating Amazon CloudWatch with the MetricFire platform, you can display your metrics on aesthetically pleasing dashboards. MetricFire's advanced filtering lets you choose only the data views you want to see and discard the rest. You can also set up simple rules to discard data you no longer keep, plus receive alerts via email or Slack when your block store is doing something it shouldn't.
MetricFire is a full-scale platform that offers infrastructure, system, and application monitoring using a suite of open-source monitoring tools. The platform allows you to use Hosted Graphite and Dashboards-as-a-Service to visualise your metrics on aesthetic dashboards.
MetricFire offers its users a complete ecosystem of end-to-end infrastructure monitoring, which is made up of popular open-source monitoring software services: Graphite, and Grafana. As well, plugins for a number of other open-source projects are preconfigured, such as StatsD, collectd, and Kubernetes. You get all these within a hosted environment as a single product. Not only does MetricFire fit well into the infrastructure monitoring use-case, such as network monitoring and server monitoring, but we also do application monitoring and business intelligence.
Through this hosted environment, MetricFire works to boost the unique features of open-source projects to give you more functionality than the original products. Below are some of the MetricFire features at a glance:
The key thing to remember is that Hosted Graphite by MetricFire is more than just Graphite. Our Hosted Graphite product actually adds data dimensionality and better data storage.
The benefits of MetricFire are:
Simple, low-cost pricing
A structured pricing model based on unique time series metrics allows you to work within your budget. The predictability and transparent pricing allow you to keep your costs in check and plan for the future. 1 metric is 1 metric.
Easily share your dashboards with clients for free.
Alert notification integrations PagerDuty, Slack, email, and webhooks.
Freedom of customization
Custom metrics through your code.
Fantastic customer support
Highly available support is provided by engineers for engineers to get you set up quickly.
Dedicated clusters for users that need their own environment.
Why thousands of engineers choose us:
Vendor lock-in's not our thing. We’re believers in you still owning your data, so you can request a full export at any time. That means you get all the benefits of an open-source tool, but with the security and stability of a SaaS tool.
“We now have over ten times the amount of metrics we started with, and on different accounts. One of the great things about MetricFire is that scaling to support this increase has been hassle-free, requiring no additional work on our side.”
Maxime Audet, Cloud-Ops Team Lead, CoveoRead customer story
Save valuable engineering time and stick within your budget. We're known for our predictable and transparent pricing so it's easy to keeps costs under control.
“Building and managing an on-premise installation at this scale would require a lot of engineer time, especially in the first year...we use this engineering time to work on initiatives closer to our core business”
Jim Davies, Head of DevOps, MoneySuperMarket.comRead customer story
Transparency is at the root of how we operate: from pricing to postmortems we're open about how we do things. We even publish our internal system metrics to our public status page.
“There’s complete transparency with everything MetricFire do which means we can accurately predict what we’ll be spending and comfortably keep within our budget.”
Itai Yaffe, Big Data Developer, NielsenRead customer story
Our first line, technical support comes from engineers, for engineers. So you get highly detailed, expert support when you need it.
"Every time I have a question, I get an answer from support after just a couple of hours. Their technical knowledge is excellent.”
Shahar Kobrinsky, VP of Architecture and Scale, EyeviewRead customer story