Developers

Using your Paglo Crawler

The Paglo Open Source Crawler — the agent that gathers information throughout your network and sends the information securely to the Paglo Search Index — can be installed on a single computer or server to probe your entire network. To see what the Crawler finds on your network, visit your Paglo Web account.

Your Crawler installs an icon in your system tray that provides you with handy quick-search capabilities. From your Crawler icon itself, you can:


Checking crawling progress

Double-click the Crawler icon in your system tray for immediate access to your Paglo Crawler. From the Crawler's Home page, you can view Crawler processes in action, perform quick searches, and more:

  • Home — Displays your Crawler scans in action, as they are pending, processing, and completed. You can also see the total number of alerts, data, and devices that your Crawler discovered so far.
  • Pending — Represents scans that are queued and pending. Each falling box represents a pending scan being added to the Crawler's queue. If you hover over a box, the name of the process appears. Most processes run quickly and should be off the screen within the first hour after the Crawler starts. The arp process takes the longest, and may stay on the screen for an hour or more. If a large number of boxes linger, indicating that many processes are taking longer than an hour, something may be amiss. Try restarting your Crawler.
  • Scans — Represents your Crawler processes in progress, as they are occurring now. Each box represents a scan that is currently being performed.
  • Completed — Represents your Crawler scans that are completed. The upper graph displays the history of scans for the past hour. The lower graph displays the summary of scans performed within the past week.
  • Messages — The field displays any error messages that the Crawler has discovered.
  • Quick Search — Displays a search field where you can run a quick search using plain English terms. This allows you to search your Search Index, which automatically launches your Paglo Web account, and displays the results of your quick search.
  • Configuration — Opens the Configuration tab, where you can modify the configuration done during the install process.
  • Support — Opens the Support tab, where you can see details about the Crawler such as version, and a direct access to Paglo Support via the Send to Support link. Click this button to send a message directly to our Support team that contains the current state of your Crawler and its log files. This message does not include your credentials.

Starting your Crawler

Crawler_start_menu_update

Your Crawler is automatically started when you first install or upgrade it. You can also stop and start the Crawler yourself at any time from the Start button on your computer desktop.

To start your Crawler:

  1. On your computer desktop, click the Start button.
  2. In the Start menu, open All Programs.
  3. In the list, click Paglo => Paglo Crawler => Paglo.





Starting your Crawler manually

To start your Paglo Crawler manually:

  1. Browse to the location in your network where you installed the Crawler. By default, that is your Program Files directory or Applications.
  2. Double-click the paglo.exe file.

Accessing your Crawler

The installation process places a Paglo Crawler icon in the system tray of your computer desktop, usually in the lower right corner. You can access your Crawler from this icon in 2 ways:


   


Quick Searches from your Crawler

You can run a quick search by typing search terms directly into your Crawler. The Crawler queries the data in your Search Index and displays the results in your browser.

To make a Quick Search directly from your Crawler icon:

  1. In your systray in the lower right corner of your screen, right-click your Paglo Crawler icon.
  2. In the pop-up menu, click Paglo Crawler.
  3. On the Home page in the query field, type a simple word or phrase in English, such as mysql. You can also enter an advanced search using Boolean operators from here, or even a PQL query such as:
    SELECT * FROM /.
  4. Click the Search execute button to display the search results in your favorite browser.
  5. Your Paglo Web account automatically opens in your designated browser with the results of your search displayed beneath the query field.

  6. Look over the results, and choose from the following options:
    • Refine this search to get more specific results.
    • Display these results as a chart, table, or graph.
    • Save the query to run again in the future.
    • Share this query with colleagues at your workplace to use.
    • Publish this query to the greater Paglo community to run these search criteria against their own data.

Stopping your Crawler

Crawler_right_click_exit

You can stop the Crawler from scanning your network by opening the Crawler icon.


To stop your Crawler:

  1. Right-click the Paglo desktop icon to launch the popup menu.
  2. In the menu, click Exit.

Extending your Crawler

You can add or remove plugins to your Crawler, or even utilize our code to build your own crawler agent:


Gauging Crawler configuration

Crawler_completeness_40

The more detailed your configuration, the richer and deeper your search results will be. You can gauge how well you configured your Crawler by viewing the Crawler Configuration Completeness on the Home page of your Paglo Web account. If your Crawler is less than 100% configured, you can improve the results of your searches by completing the network connection, Windows, and switch credentials configurations, to give the Crawler the bare minimum to read your network. You can further improve your Crawler's depth by providing network information.


Getting Crawler support

On the Support tab, you can see details about the Crawler such as version number, as well as a direct access to Paglo Support via the Send to Support link.


Accessing your Company data key

Your company data key is available on the Account tab of your Crawler's Configuration dialog box. Paglo uses this key to associate information from your Crawler with your Search Index. This key helps keep your data secure, private, and under your control. You can see the same data key on the Account link of your Paglo Web account. If you call Paglo Support, this key will help identify your account.


How do I find out more?