"System Log"
"Thu Oct 16 12:28:00 EDT 2008 - Thu Oct 16 12:58:00 EDT 2008"
"Date" "Message" "Severity"
"Thursday, October 16, 2008 12:56:02" "It seems the collector is unable to keep up with the amount of traffic received, 355 data elements queued" "Errors Only"
"Thursday, October 16, 2008 12:54:02" "It seems the collector is unable to keep up with the amount of traffic received, 354 data elements queued" "Errors Only"
"Thursday, October 16, 2008 12:52:02" "It seems the collector is unable to keep up with the amount of traffic received, 353 data elements queued" "Errors Only"
"Thursday, October 16, 2008 12:50:04" "Source xxx.xxx.xxx.xxx flushed in 0.88 (0.88) seconds. Stats - Keys: 8085, Flows: 41100, Packets: 302271, Bytes: 128944770, Unclassified Flows: 54" "Verbose"
"Thursday, October 16, 2008 12:50:03" "Flush Exception An item with the same key has already been added.,    at System.ThrowHelper.ThrowArgumentException(ExceptionResource resource)
   at System.Collections.Generic.Dictionary`2.Insert(TKey key, TValue value, Boolean add)
   at BWCollector.Net.CBandwidthAggregation.LoadNewAggregationKey()
   at BWCollector.Net.CBandwidthSource.LoadNewAggregationKey()
   at BWCollector.Net.CBandwidthCollector.AddKeysToCache()
   at BWCollector.Net.CBandwidthCollector.MoveData(DateTime dLastFlush)
   at BWCollector.Net.CBandwidthCollector.Flush()" "Errors Only"
"Thursday, October 16, 2008 12:50:02" "It seems the collector is unable to keep up with the amount of traffic received, 354 data elements queued" "Errors Only"
"Thursday, October 16, 2008 12:49:03" "Error moving keys System.Data.SqlClient.SqlException: Timeout expired.  The timeout period elapsed prior to completion of the operation or the server is not responding.
   at System.Data.SqlClient.SqlConnection.OnError(SqlException exception, Boolean breakConnection)
   at System.Data.SqlClient.SqlInternalConnection.OnError(SqlException exception, Boolean breakConnection)
   at System.Data.SqlClient.TdsParser.ThrowExceptionAndWarning(TdsParserStateObject stateObj)
   at System.Data.SqlClient.TdsParser.Run(RunBehavior runBehavior, SqlCommand cmdHandler, SqlDataReader dataStream, BulkCopySimpleResultSet bulkCopyHandler, TdsParserStateObject stateObj)
   at System.Data.SqlClient.SqlDataReader.ConsumeMetaData()
   at System.Data.SqlClient.SqlDataReader.get_MetaData()
   at System.Data.SqlClient.SqlCommand.FinishExecuteReader(SqlDataReader ds, RunBehavior runBehavior, String resetOptionsString)
   at System.Data.SqlClient.SqlCommand.RunExecuteReaderTds(CommandBehavior cmdBehavior, RunBehavior runBehavior, Boolean returnStream, Boolean async)
   at System.Data.SqlClient.SqlCommand.RunExecuteReader(CommandBehavior cmdBehavior, RunBehavior runBehavior, Boolean returnStream, String method, DbAsyncResult result)
   at System.Data.SqlClient.SqlCommand.RunExecuteReader(CommandBehavior cmdBehavior, RunBehavior runBehavior, Boolean returnStream, String method)
   at System.Data.SqlClient.SqlCommand.ExecuteReader(CommandBehavior behavior, String method)
   at System.Data.SqlClient.SqlCommand.ExecuteReader()
   at WhatsUp.CRs.Open(SqlCommand oSqlCommand)" "Normal"
"Thursday, October 16, 2008 12:48:02" "It seems the collector is unable to keep up with the amount of traffic received, 353 data elements queued" "Errors Only"
"Thursday, October 16, 2008 12:46:02" "It seems the collector is unable to keep up with the amount of traffic received, 352 data elements queued" "Errors Only"
"Thursday, October 16, 2008 12:44:02" "It seems the collector is unable to keep up with the amount of traffic received, 351 data elements queued" "Errors Only"
"Thursday, October 16, 2008 12:42:02" "It seems the collector is unable to keep up with the amount of traffic received, 350 data elements queued" "Errors Only"
"Thursday, October 16, 2008 12:40:02" "It seems the collector is unable to keep up with the amount of traffic received, 349 data elements queued" "Errors Only"
"Thursday, October 16, 2008 12:38:30" "Source xxx.xxx.xxx.xxx flushed in 0.63 (0.63) seconds. Stats - Keys: 7152, Flows: 41010, Packets: 293898, Bytes: 124596549, Unclassified Flows: 29" "Verbose"
"Thursday, October 16, 2008 12:38:29" "Flush Exception An item with the same key has already been added.,    at System.ThrowHelper.ThrowArgumentException(ExceptionResource resource)
   at System.Collections.Generic.Dictionary`2.Insert(TKey key, TValue value, Boolean add)
   at BWCollector.Net.CBandwidthAggregation.LoadNewAggregationKey()
   at BWCollector.Net.CBandwidthSource.LoadNewAggregationKey()
   at BWCollector.Net.CBandwidthCollector.AddKeysToCache()
   at BWCollector.Net.CBandwidthCollector.MoveData(DateTime dLastFlush)
   at BWCollector.Net.CBandwidthCollector.Flush()" "Errors Only"
"Thursday, October 16, 2008 12:38:02" "It seems the collector is unable to keep up with the amount of traffic received, 350 data elements queued" "Errors Only"
"Thursday, October 16, 2008 12:37:29" "Error moving keys System.Data.SqlClient.SqlException: Timeout expired.  The timeout period elapsed prior to completion of the operation or the server is not responding.
   at System.Data.SqlClient.SqlConnection.OnError(SqlException exception, Boolean breakConnection)
   at System.Data.SqlClient.SqlInternalConnection.OnError(SqlException exception, Boolean breakConnection)
   at System.Data.SqlClient.TdsParser.ThrowExceptionAndWarning(TdsParserStateObject stateObj)
   at System.Data.SqlClient.TdsParser.Run(RunBehavior runBehavior, SqlCommand cmdHandler, SqlDataReader dataStream, BulkCopySimpleResultSet bulkCopyHandler, TdsParserStateObject stateObj)
   at System.Data.SqlClient.SqlDataReader.ConsumeMetaData()
   at System.Data.SqlClient.SqlDataReader.get_MetaData()
   at System.Data.SqlClient.SqlCommand.FinishExecuteReader(SqlDataReader ds, RunBehavior runBehavior, String resetOptionsString)
   at System.Data.SqlClient.SqlCommand.RunExecuteReaderTds(CommandBehavior cmdBehavior, RunBehavior runBehavior, Boolean returnStream, Boolean async)
   at System.Data.SqlClient.SqlCommand.RunExecuteReader(CommandBehavior cmdBehavior, RunBehavior runBehavior, Boolean returnStream, String method, DbAsyncResult result)
   at System.Data.SqlClient.SqlCommand.RunExecuteReader(CommandBehavior cmdBehavior, RunBehavior runBehavior, Boolean returnStream, String method)
   at System.Data.SqlClient.SqlCommand.ExecuteReader(CommandBehavior behavior, String method)
   at System.Data.SqlClient.SqlCommand.ExecuteReader()
   at WhatsUp.CRs.Open(SqlCommand oSqlCommand)" "Normal"
"Thursday, October 16, 2008 12:36:02" "It seems the collector is unable to keep up with the amount of traffic received, 349 data elements queued" "Errors Only"
"Thursday, October 16, 2008 12:34:02" "It seems the collector is unable to keep up with the amount of traffic received, 348 data elements queued" "Errors Only"
"Thursday, October 16, 2008 12:32:02" "It seems the collector is unable to keep up with the amount of traffic received, 347 data elements queued" "Errors Only"
"Thursday, October 16, 2008 12:30:02" "It seems the collector is unable to keep up with the amount of traffic received, 346 data elements queued" "Errors Only"
"Thursday, October 16, 2008 12:28:02" "It seems the collector is unable to keep up with the amount of traffic received, 345 data elements queued" "Errors Only"

We would need to change some options to keep data for a shorter period of time, and to do maintenance more often. 

I would contact you directly offering help.

Claudio Robles
Ipswitch Network Monitor Team

Claudio Robles
Ipswitch Network Monitor Team

I have the exact same problem. During the beta testing NetFlow was running for months without any issue. Last week I bought and installed this on our productive systems and about three days in it stopped working. All may 4 sources say "Not receiving". We also have 2005 std (full version) and whatsup runs on the same server. In addition to the same errors posted by vawebprop our database grew (even though it says it was not receiving any data) by 10GB over night. I can only stop the growing by stopping the NetFlow collector service.

I tried to use the DB maintenance but due to the size of the DB it always times out. I reduced the setting to keep data for 1 hour only but nothing helps. The DB is currently around 12GB and I can't do anything about it. Will there be a fix out for this soon?

Thanks

  In version 12.3 we have a temporary table that under some conditions did not get clean and therefore it grows and grows.  We have fixed that in the version that is coming out in a week (12.3.1).

   You could truncate the table yourself, or we can help you.  The table is FlushKey in the netflow database, so a command "truncate table FlushKey" will be enough.

Claudio Robles
Ipswitch Network Monitor Team