Handle gigabytes of log and queue data

Iguana X has a log generator tool built into it which will import and replicate a lot of log data by using the works of Shakespeare.

How do you use it?

In order to use the logging and queueing system, first we’ll need a component. Do the following:

From the dashboard of Iguana X, click on +Component

In Add Components create a Custom component

In the Add Components dialog that pops up, select Custom

Change the name of the component to Source

Click Add in the bottom right of the dialog.

You should see a new component appear in the dashboard.

Change your URL to go to have #log_generator at the end of it

You will need to edit the URL of your page carefully to have the #log_generator in it.

This might look like http://localhost:7654/#log_generator depending on how your Iguana is configured.

In Chrome this looks like:

In Safari it might look different:

Generate the logs

On this new page, use the dropdown to select the Source component created in the earlier part
Also change the number of months of logs to generate to 60
Click Run and wait for the log generation to finish
- When finished, the output looks like this:

Go to the logs section and select your component

This screen shot shows how to navigate to the logs and view the data you have generated.

Now search for the magic string

Follow these steps:

The logs displayed will jump to the first result and highlight the match, and the search will continue to run and find more results which is what the white expanding region in the control bar is about.

The progress of the search can be seen in two places:

Below the search field where it shows how far back in time the search has gone
The scroll bar on the right will fill up with white as an indication of how far along the search is

The previous and next arrows to the right of the search field can be used to jump between results:

Now stop and start Iguana

Go to the dashboard and then stop and start Iguana.

Iguana will start quickly even though you have a lot of log data. We’ve engineered Iguana to handle logs for as log as you need them, without performance degradation.

Log resubmission

Often when a new system is brought into an existing integration the messages for the last few months or years are replayed to bring the system up to speed. Iguana X provides a solution for this in the form of log resubmission.

STEP 1 : Add a destination component

From the previous parts, we have a component set up with 5 years of log data. In order to try this out, we will need another component.

From Iguana X’s dashboard, click + Component
In the Add Components dialog that pops up, select Custom, which should be the first option
- It is recommended to change the name of the component. This guide proceeds assuming you renamed it Destination
Then click Add in the bottom right of the dialog
You should see a new component appear on the dashboard

STEP 2 : Link the components together

Now we will need to link the two components together so that messages can be pushed from one component to another . Assuming Source is the component with the logs and Destination is the component created above, do this by:

From Iguana X’s dashboard, click Edit Connections
First click Source, then click Destination
A link should appear connecting the two, with the arrow on the link pointing from Source to Destination
Click on Edit Connections again to exit this mode

STEP 3 : Reposition the queue

Now that the components are linked, we can reposition the queue.

From Iguana X’s dashboard, double click on Source to bring up the component card
In the Queue Position row click reposition
Use the date picker to go back in time 5 years
- An Error can appear:
  Fix: If you see that, then just increment the day by 1 until the error is gone.
Once you have a valid start reposition time, click reposition to reposition the queue
Exit out of the reposition dialog and then exit out of the component card. This can take a few seconds.

STEP 4: Turn on the Destination Component to begin the reposition

For Destination the QUE column on the dashboard should read some large number of days depending on how far back the queue was repositioned
Going to the Logs tab and selecting Destination as the component, you should see a log message showing that a new queue position was accepted
Going back to the dashboard and running the Destination component by toggling the switch, the component will begin to process messages from its queue and the QUE value will start to decrease

Now see if you can understand from the Logs screen how to resubmit a specific message

Good luck - we’re interested to see if you can figure this out from the user interface!