ftp monitoring tool

Why did we build FTP/SFTP Monitoring for BizTalk Server?

Published on : Apr 11, 2018

Category : BizTalk360 Update

Lex

Author

This blog is a part of the series of blog articles we are publishing on the topic “Why did we built XYZ feature in BizTalk360”.

Introduction

After reading this article, you’ll learn the following:

  • Why do you need FTP/SFTP Monitoring feature?
  • What are the current challenges in BizTalk Server?
  • How does BizTalk360 solve monitoring problems?

Why do you need this feature?

In the day-to-day activities of a BizTalk administrator, you might come across integrations where FTP sites are used for receiving and transmitting messages. FTP sites are often used for cross-platform integrations. For example, when you have an SAP system on Unix that must be integrated, via BizTalk Server, with other systems, you might use FTP for receiving and transmitting of messages.

SFTP & FTPS are just the secured version of FTP with advanced transport encryption mechanisms, so your end-to-end data transmission is secure and safe.

To keep the business process going, it can be of vital importance that the FTP/SFTP sites are online and the messages are being picked up. So, when a BizTalk administrator needs to be constantly aware of whether the FTP/SFTP sites are online and working properly, the administrator needs to monitor the sites and the activities which take place on these sites.

What are the current challenges?

BizTalk Server offers no monitoring capabilities, not for Receive Locations / Send Ports and also not for endpoints like FTP, SFTP and FTPS sites. So, using just the out-of-the-box features of BizTalk Server, a BizTalk administrator will have to manually check whether the FTP sites are online and whether all (appropriate) files are being picked up for further processing.

Manual monitoring

This kind of manual monitoring can be quite cumbersome and time-consuming. The administrator will probably use multiple pieces of software to be able to perform these tasks. Think of for example the BizTalk Administration console to check whether the Receive Locations/Send Ports are up and some FTP client to check whether files are being picked up.

It is obvious that this is not a very efficient scenario, which could easily be automated by setting up monitoring.

cta

Maintaining scripts for monitoring FTP sites

To reduce their workload, we experience that BizTalk administrators are creating their own scripts to monitor FTP sites and all kinds of other resources. Although this kind of script certainly can be of help, we still think this does not fully solve the problem.

For example, often these kinds of scripts need maintenance when FTP sites need to be added, changed, or deleted from monitoring. This kind of task can be easily forgotten.

Also from a knowledge transfer perspective, it’s easy to forget to update new colleagues about the existence of this kind of script, as they will probably be installed on some (monitoring) server.

Another challenge with solving this kind of problem with scripts is that not each administrator is capable to write this kind of script, which makes knowledge transfer even harder.

To keep the overview, we think that it is easier to use software, like BizTalk360, to have everything in one easily accessible place, with good visibility of all the features/capabilities, fine-grained security/auditing, and without the need to maintain custom scripts, etc…

How does BizTalk360 solve this problem?

FTP Monitoring tool

We make monitoring of FTP/SFTP/FTPS sites a lot easier with BizTalk360(FTP Monitoring tool). For a very long time, the product offers monitoring of Receive Locations and Send Ports, but for some time now, BizTalk360 has also offered to monitor the physical FTP/SFTP/FTPS endpoints.

We wanted to make setting up this kind of endpoint monitoring as seamless as possible and therefore we simply show all the ports in the current BizTalk group which make use of the FTP/SFTP/FTPS adapter.

In BizTalk360, you can find FTP monitoring under Monitoring => Manage Mapping => File Locations (File, FTP, SFTP).

BizTalk FTP Adapter

Next, you can set up monitoring rules based on File Count and Directory Size and have BizTalk360 send Warning or Error notifications through the notification channels which are configured on the associated alarm.

A fully monitored FTP endpoint might look like shown below.

FTP Monitoring Tool

Of course, besides the greater-than-or-equals operator, also other common operators are available.

Conclusion

As a final point, we see from time to time that administration teams maintain a administrator’s handbook, which contains all the tasks a (BizTalk) administrator should take care of. We think that by using software like BizTalk360, we can reduce the number of pages in such handbooks, as the kind of scripts we mentioned no more have to be described in that kind of book.

This description could be replaced by, for example, a general guideline on how FTP sites should become monitored and the monitoring rules with BizTalk360.

As a result, we hope to make the work of BizTalk administrators a bit easier so the team can focus on the more exciting parts of the job of BizTalk administrators, instead of constantly having to update their handbooks.

So, we think that we make the day-to-day life of a BizTalk administrator, who needs to monitor the well-being of FTP sites, a little bit easier by bringing this feature.

BizTalk360 also offers an advanced monitoring capability called “Data Monitoring” which allows monitoring the traffic/volume of messages going through the ports for a given period, Eg: expected 50 PO orders from our partner via FTP/SFTP.

Please check out this article, Introducing BizTalk Server Data Monitoring in BizTalk360

BizTalk360 new release v10.0 is out now!

BizTalk360 helps you to manage/operate and monitor your BizTalk Server environments. Our BizTalk360 team has worked on the v10.0 release for more than a year. Last year, we have released v10.0, a new version of BizTalk360 where you will find an even better user experience that enables you to enjoy the latest features that have been developed.

Get started with a Free Trial today!

Download and try BizTalk360 on your own environments free for 30 days. Installation will not take more than 5-10 minutes of your time.