How this Telecom Network Testing Company Automated Emailing of Hotspot Reports from Kibana and Grafana to 3,000 Technicians

Executive Summary

 
This case study will show how Enghouse Systems, a telecom network testing solution provider to the leading service providers in North America, automated emailing of daily and weekly test reports in PDF format from its Elasticsearch-Kibana-Grafana data lake to three thousand field technicians and their managers.
 
Automated test reports helped the Enghouse technicians and managers to address the most critical issues in their customer switches and maintain the SLAs for their telecom networks. Enghouse was able to accomplish this goal even though they did not have the enterprise subscription for Elastic Stack or Grafana.
 
In this case study, we’ll show you how reporting is critical for Enghouse’s telecom testing business and how Enghouse added reporting to Kibana and Grafana using Skedler to implement this key business requirement.
 

The Secret to Keeping Telecom Networks Humming

 
Testing and monitoring telecom service providers’ networks for failure and hotspots is one of the key lines of business at Enghouse, a global company with business ranging from software development to integration. Enghouse got into the Telecom network testing business through the acquisition of Tollgrade which developed both hardware and software solutions for Telecommunications. Tollgrade’s solution will test the service provider’s phone lines and if the customer has a metallic connection, it will also provide information based on Digital Subscriber Line Access Multiplexer(DSLAM) or Gigabit Passive Optical Networks(GPON).
 
Enghouse has hardware in different central offices across the various states in the US. This hardware will test metallically the lines of the switch. It will test whether the measurement heads are testing properly. Testing is broken down by switch clusters in specific states. Over 3000 technicians across the US monitor the data coming from these tests.
 

Migrating Test Data Platform from Legacy Infrastructure to Elasticsearch, Kibana and Grafana

 
Enghouse had developed their own system for providing testability information to the telecom companies that use their software. Since it is not user friendly and not accessible via browser, they migrated to a browser based solution that was built using Elasticsearch as the backend database with Kibana and Grafana as the frontend dashboard applications.
 
Depending on the type of visualization needed, either Kibana or Grafana is used to visualize the test data captured in Elasticsearch.
 
The powerful combination of Elasticsearch, Kibana and Grafana enabled customers and technicians to easily access the data and visualize the information that they need to monitor.

Check out the complete video of John Hirth speaking about his use case.
 

Email Daily Reports to 3000 Technicians

 
The legacy product line had the ability to send out reports to the field technicians and managers. The first set of reports is sent to technicians in a particular state. It will provide a daily summary of the metallic test data from the lines off the switch clusters in that state. The technicians will come to know if the measurement heads are testing properly. More than 3000 technicians receive the daily summary reports that are critical for their day-to-day work. The reports help the technicians identify the switches that require immediate attention and fix them in a timely manner.
 

Weekly Hotspot Reports to Managers

 
The second report is a hotspot report that is delivered to the managers. This report gives the managers an overview of what is going on in their network. Since the technician’s time is valuable, the managers use this report to direct their technicians to address issues in critical central offices.
 

 
The technician report goes out Monday through Friday and the hotspot report is sent out every Tuesday.
 

Missing Reporting Capability in Kibana and Grafana

 
Enghouse uses the open source version of Elasticsearch, Kibana and Grafana. Since Kibana and Grafana don’t offer reporting unless you purchase their enterprise subscriptions, John Hirth, the Program Manager responsible for the monitoring system, searched the internet for an affordable tool that generates reports from Kibana and Grafana. That’s how he came across Skedler, the Kibana and Grafana reporting solution.
 

Kibana and Grafana Reports to 3000 users in
Just 2 months

 
John got in touch with the Skedler team, saw a demonstration, and ran a proof of concept. After a successful PoC that involved automating sample reports for technicians and managers, he purchased Skedler license and activated the license in his PoC environment. He used Skedler to build additional technician reports and hotspot reports off his Kibana and Grafana dashboards.
 

 
With management being able to have an email sent to them that says, “Hey, something’s going wrong” is a tremendous value. “They need to work on the critical issues and having the ability to send the report or alert saying something’s wrong is very valuable” says John.
 

John Hirth’s Word of Wisdom for Kibana and Grafana Users

 
Last, but not least, John Hirth recommends companies to check out Skedler if they want to have an application that they can quickly bring up and satisfy their Kibana and Grafana reporting needs. “It’s a great fit,” says John.
 
If you found this case study inspiring, we’d really appreciate it if you would share the story on Twitter/LinkedIn/Facebook or other forums.
 

How this Managed Detection and Response Team Automated Cybersecurity Reports to Customers from Elasticsearch Kibana

Executive Summary

 
This case study will show how Cynet, a cybersecurity platform and service provider from Israel, automated emailing of security reports to its customers in PDF format from its Elasticsearch-Kibana security data lake and freed up more than 20 hours per month of employee time.
 
Visual security reports help the Cynet Managed Threat Detection and Response(MDR) service team to drive value to customers about their unique solution and meet the customer SLA requirements. Cynet was able to easily accomplish their goal of automating insightful cybersecurity reports to their major customers within one month and freed up tens of hours per month for its Operations team.
 
In this case study, we’ll show you how reporting helps the Cynet MDR Cybersecurity Operations Team and how Cynet accomplished this key business requirement.
 

Cynet’s Unique Approach to Cybersecurity

 
More than ever, Cybersecurity is at the top of mind for all organizations. The recent Solarwinds hack not only highlights the sophistication of the attacks, but also brings the need for an equally sophisticated cybersecurity strategy and operations for every organization to the forefront. And this is exactly the forte of Cynet, a cybersecurity platform and services provider based in Israel.
 
Cynet was started in Israel five years ago to focus on endpoint detection and protection while delivering included security service on top of their dedicated Cynet 360 platform. The unique advantage of Cynet is that their Managed Threat Detection and Response(MDR) service is included free of cost with their Cynet 360 platform to all their customers. Its customers include large and medium sized organizations such as Allianz, Costa Crociere, and East Boston Neighborhood Health Center.
 

The Secret Sauce of Cynet Managed Detection & Response Service

 
Cynet’s MDR service is offered by the Cyber Operations(CyOps) team which is led by Shiran Grinberg, CyOps Manager and Sivan Chachashvili, CyOps Team Leader. The CyOps team is a 24×7 SWAT team of seasoned professionals focused on identifying threats and vulnerabilities in customer environments and providing the human oversight necessary to detect and respond in a timely manner.
 
On any given day, the CyOps team goes through tons of data and alerts coming from the customer environment. They use Elasticsearch to capture and analyze the customer environment security data. Kibana is used to visualize the data. The CyOps team analyzes the alerts and decides if the alerts are traces of malicious activity. If they are malicious, a chain of events called Incident Response is initiated to mitigate and remediate the threat in the customer environment.
 

Using Cybersecurity Reports to Drive
Customer Value

 
The CyOps team needed to present the findings from their analysis to clients in a visual manner. While their Cynet360 platform is used for monitoring the activities, customers needed monthly and quarterly reports of the security posture of their environments. These reports not only provide insights to customers about their cybersecurity readiness but also help Cynet accentuate the value delivered by its unique combination of MDR platform and CyOps service. The reports increase customer retention and also differentiate Cynet from its competitors.
 
Check out the complete video of Shiran and Sivan speaking about their company and how they use Skedler for MDR Reporting from Kibana.
 

Manual Reporting from Kibana was
Time-Consuming

 
Since the open source version of Kibana lacked reporting capability, the CyOps team had to manually create these reports for each of its customers. They would first create the visualizations in Kibana, take screenshots, paste them into a report, format the report, email it to their customer and repeat it for each and every customer.
 
Needless to say, this was a cumbersome and time consuming process. A CyOps team member was spending several days per month to create these customer reports. It became unsustainable and forced the CyOps team to look for tools that could automate the report creation and distribution.
 

Cynet Automates Export of Kibana Reports
with Skedler

 
The CyOps team evaluated three potential solutions for Kibana reporting and ultimately chose Skedler as their Kibana reporting solution. “We just took Skedler as it was the best solution for us”, says Sivan Chachashvili. For CyOps team, it’s the manpower and the time saved every month by not spending countless hours to take screenshots and manually create reports for customers.
 

 
“Within one month, we have produced 20 reports for most major customers using Skedler and we’ve already started to gain traction”, says Shiran Grinberg, CyOps Team Manager at Cynet.
 

Last Word, But Not the Least, from CyOps Team

Skedler’s technical prowess was not the only factor that impressed Cynet. Shiran and team were pleased with the sales and after-sales support provided by the Skedler team. “Sales and support team is a part of the overall picture or the overall product. Once you have people who you can communicate with, they understand you and you understand them, it makes everything way easier.” concludes Shiran.
 
If you found this case study inspiring, we’d really appreciate it if you would share the story on Twitter/LinkedIn/Facebook or other forums.
 

How this India’s Publishing Group is Winning at Digital with an Early Warning System for its Online Newspaper

The Hindu and many other popular news outlets in India are running smoothly thanks to Skedler.

Client profile: The Hindu Group

• One of the oldest publishing companies in India. Publisher of The Hindu, a daily newspaper that began in 1878 and has been steadily growing in circulation ever since.
• The Hindu’s independent editorial stand and its reliable and balanced presentation of the news have won the serious attention and regard of the people who matter in India and abroad.
• The Hindu uses modern facilities for news gathering, page composition and printing. It is printed in seventeen centers across India that are connected with high-speed data lines.

The increasing use of mobile devices over the last decade has fuelled a desire on the part of online news outlets to provide readers with an improved mobile experience across all kinds of browsers. This effort is sometimes hampered by unforeseen browser incompatibilities, resulting in browsing anomalies for some readers. Because smooth user experience is so essential in attracting and retaining audiences, most news websites are continuously striving to detect and deal with such problems quickly and efficiently.

Poonkuyilan V is one of the often unsung, behind-the-scenes heroes that keep the online reading experience bug-free. He works at India’s national newspaper – The Hindu – where he leads the IT department’s infrastructure team. His team is responsible for maintaining the smooth operation of the website.

Things are a bit chaotic before Skedler

Initially, Poonkuyilan and his team used Elastic Stack for the access logs only, but as they became more comfortable with it, they began using it for all of the logs: “We feed the logs into Elasticsearch to analyze them. The visualization tool we like to use is Kibana, a very user-friendly tool that is part of Elasticsearch. These visualizations make it straightforward for us to not just solve any issues that may come up, but to also find what’s causing them much easier compared to the traditional way of log monitoring.” In addition to monitoring, Poonkuyilan’s team is responsible for the availability and integrity of the websites. Once they get an alert that something is wrong, they have to react based on that alert. However, the IT team was becoming very aware that most of the alerts weren’t coming from the Elastic Stack tool’s Elastalert, but rather from the end-users. Many readers were not having a smooth experience using The Hindu Group’s websites.

“Indeed, the readers would call or email us, asking how to fix a problem with the website pages or why a certain anomaly keeps happening. So then we would go into the system to look at the numbers and to solve the issue,” remembers Poonkuyilan. Anyone can see the problem here. Relying on end-users to signal about problems in your product is not the optimal way to attract and retain readers. It was clear to everyone in the IT team that a more proactive approach was required. That’s when Poonkuyilan and his colleagues started actively searching for viable alternatives to the Elastalert: “We were looking at online forums and that’s how we discovered the existence of Skedler. Once we downloaded it and connected it to the Elasticsearch, Skedler started generating alerts right away. The whole process was very intuitive and provided us with a way to easily configure alerts right in the dashboard.”

Check out the complete video of Poonkuyilan speaking about his use case.

The team’s favorite Skedler features

Poonkuyilan admits he finds other alerting systems for the Elastic Stack a bit too difficult to use: “You need to understand the data and you also need to understand the tool you are trying to implement. They often require some development effort to work correctly, so it’s not that easy for some of the team members to create an alert.

One of The Hindu Group’s IT team’s favorite Skedler features is the ability to create alerts in the console itself within two or three minutes: “We have Skedler directly integrated in the Elasticsearch, which is great. Creating alerts directly in the console itself is a fantastic feature. We also found all the available pre-defined templates to be a really nice touch as well.”

Another Skedler feature that has recently become a team favorite is the way Skedler generates weekly reports: “Some of the top-level management don’t really need daily alerts; they just want to receive a high-level, weekly report that outlines what’s happened in the website during the week,” says Poonkuyilan, “Sometimes all they want is a monthly report. In these weekly and monthly reports where we are including data about any 503 errors that may have occurred, as well as stats on the responsiveness of the websites and the pages. This is where Skedler really helps us with how easy and intuitive it is to understand how the pages have performed”

Poonkuyilan says that Skedler has definitely helped his team in fine-tuning the monitoring process: “Thanks to its sensitive alerting system, we started pinpointing what the anomalies and issues were going to be before they even occur. We truly appreciate Skedler’s ease of use. We can set alarms quickly and then concentrate on the day-to-day work and other processes. We don’t have to fiddle with the alarm settings at all. In fact, since we began using the Skedler tool, there haven’t been any major incidents with any of The Hindu Group online publications!”

If you found this case study inspiring, we’d really appreciate it if you would share the story on Twitter/LinkedIn/Facebook or other forums.