TwoToneDetect, time to send Email?

[jmoflhrc]

Hello guys, I'm new to posting here but I have a quick question. How long does it take your TwoToneDetect setups to send an email after the MP3 conversion is complete. I have 40 users in my email list, Should 1 minute be normal to send the email? I have attached a copy of a log from a call earlier today for reference.

Thanks!
-Jason


Darien Fire Department Tone Set Found
delay timer Darien Fire Department 18:22:58 on 03/08/14
2.0
1231.0 7345.96418338
1231.0 7324.11121923
1231.0 7885.02258136
1231.0 7306.80603521
1231.0 7848.52950302
1231.0 7466.45600111
1231.0 7268.07685641
1231.0 7438.69932361
1231.0 7878.70942249
1231.0 7421.85233601
1231.0 7258.71276933
1231.0 7079.16378471
delay done Darien Fire Department 18:23:01 on 03/08/14
waiting for audio Darien Fire Department 18:23:01 on 03/08/14
threshold value: 22.627416998
mono
threshold exceeded
recording audio Darien Fire Department 18:23:01 on 03/08/14
1231.0 7256.94600946
414.0 1414.96243873
1290.0 1071.3811494
645.0 909.816138585
333.0 1141.30447893
828.0 1133.64922761
457.0 945.096207465
478.0 1129.01876065
435.0 7093.28714305
397.0 1342.29343334
440.0 6785.12343498
403.0 4187.54779879
591.0 11977.4454366
672.0 2497.64318084
478.0 3759.97285843
500.0 1081.53472039
828.0 978.127020993
704.0 1528.06781551
494.0 4352.71668607
430.0 2184.77165484
457.0 1352.40215836
489.0 3940.7374426
435.0 1601.12855125
419.0 1367.85614276
451.0 7272.06135025
387.0 3840.49712201
478.0 12687.6819154
478.0 1830.78624266
344.0 1109.30612034
295.0 1092.48820802
435.0 1014.82785616
397.0 8361.60328443
446.0 12262.2088461
435.0 10021.9131006
430.0 9930.48699392
1027.0 969.885405693
532.0 1063.06133478
629.0 1085.33934173
397.0 10619.0303491
419.0 3743.04613042
510.0 4688.09877586
451.0 2875.42735757
914.0 2956.1140924
403.0 5040.95225181
397.0 1611.76317101
473.0 3265.94850208
494.0 2743.43370805
483.0 4350.26548271
451.0 2120.24149551
500.0 1641.15950352
532.0 3343.00993314
828.0 1390.98852519
430.0 7692.11978936
462.0 9827.4263837
451.0 3954.82100639
430.0 5181.5721461
516.0 10173.1134552
392.0 1484.76856835
914.0 1175.63151321
1086.0 1173.51228648
844.0 1499.22476704
440.0 1077.67636425
483.0 6940.33875584
419.0 11761.0887489
408.0 2292.68493884
397.0 7890.21114184
483.0 1412.4426048
489.0 1546.0808892
666.0 3622.3944448
473.0 1378.43932133
591.0 1233.64097331
392.0 8084.91246286
414.0 8445.86884381
489.0 8013.29782301
483.0 1920.6607589
973.0 1629.30803654
946.0 10657.6532255
478.0 2865.97523657
403.0 1156.65133885
333.0 1626.75254314
1365.0 7932.89362372
1215.0 8408.4794005
408.0 1150.88745395
656.0 4070.33446065
435.0 1273.57592888
457.0 2398.77085376
774.0 1091.26475963
747.0 882.315308345
Waiting for Silence Darien Fire Department 18:23:29 on 03/08/14
Done recording Darien Fire Department 18:23:31 on 03/08/14
done writing WAV Darien Fire Department 18:23:32 on 03/08/14
done converting to MP3 Darien Fire Department 18:23:32 on 03/08/14
MP3 Email sent! Darien Fire Department page received at 18:23:32 on 03/08/14 18:24:29 on 03/08/14

 

[FireTTD]

Hey Jason,

Are you not receiving the emails from TTD? Did the tone and email go through when it was paged out today?

Best,
Mike
FireTTD

 

[jmoflhrc]

Hey Mike, thanks for the reply. I am getting the emails I am just wondering if a 1 minute time between the MP3 encoding finish and email sent is normal. If so cool, just making sure there is nothing wrong with my setup.

Thanks!
-Jason

 

[nick223]

Are you sending them to email addresses? Or are you sending them as cell phone text alerts? Email addresses comes in faster then a text alert. A minute is a good guess. But for text alerts on a cell phone it all depends on the phone carrier provider. Sometimes I get my texts instantly other times it could be 5 mins- days later.

 

[jmoflhrc]

All recipients are email addresses. It's not the time from email sent to actually getting it in my inbox I'm worried about, I am seeing around 20-30 seconds for that. It the actual time it takes TwoToneDetect to send the email after MP3 is processed.


Done Converting MP3: 18:23:32 03/08/14
MP3 Email sent: 18:24:29 03/08/14

The actual MP3 file size for this call was 329KB. I am on a 120/35mbit internet connection so that is not the issue.

If this is normal cool, I'm just checking to see if something is wrong with my setup.

Thanks!
-Jason

 

[FireTTD]

Jason,

To me, it seems like 57 seconds (or there abouts) is the appropriate time for delivery to email. Some of that may depend on resources such as processing speed and ram. But seems like that's a legit amount of time between creating the file and emailing it.

That's just my two cents tho.

Best,
Mike
FireTTD

 

[jmoflhrc]

Thanks for the reply Mike, that exactly what I'm looking for.

I am going to try breaking the email list up into two instances of TDT and see if that changes things any. My hope is to get the alert sent out was quickly after the mp3 is done.

-Jason

 

[FireTTD]

Thanks for the reply Mike, that exactly what I'm looking for.

I am going to try breaking the email list up into two instances of TDT and see if that changes things any. My hope is to get the alert sent out was quickly after the mp3 is done.

-Jason

Maybe you could just take and add just your email into the list first, and then see how it reacts and if you get a quicker response time. If you do, then you know it has something to do with the size of the list. If you don't, then you may want to keep tracking the delay down.

As a side note, you would have to use something like Audacity to play your mp3 and see if you can get it to trigger TTD so you can test it. If you already have an mp3 generated, you can play around with TTD with a few variations of ways to get it to execute the mailing features within it.

If you need some help, post back here and I can help walk you through it.

Best,
Mike
FireTTD

 

[jmoflhrc]

Good Idea, I have recordings of all our pages so I can use one of those for testing.

-Jason

 

[FireTTD]

Depending on how you have the timing set for recordings, you may have to see if you can catch the tones as well on the page, so it will trip TTD for you. Otherwise you will need to create the tones and then merge it to the front of your audio file so that when you play it - it trips TTD to start recording.

Best,
Mike
FireTTD

 

[jmoflhrc]

I've got a separate program (ProScan) recording the raw radio traffic so it should work perfect for this test.

I'll throw some MP3s at TDT later this evening and get some more data.

Thanks!
-Jason

 

[DC31]

I've got a separate program (ProScan) recording the raw radio traffic so it should work perfect for this test.

I'll throw some MP3s at TDT later this evening and get some more data.

Thanks!
-Jason

For what it is worth, my raspberry pi setup is 3-5 seconds from the done converting to Email Sent and about 7 seconds from the Done Recording to the Email Sent. This seems to be consistent regardless of whether there are 20 addresses in the list or 2.

My guess is that the delay you are seeing may be on the email provider's end. TTD has done its thing when the converting is done. There must be some sort of handshake that is done with the email provider confirming that the emails were sent. That may be taking a minute to complete. I use Gmail to send the TTD emails and to receive my alerts. Many times my phone is beeping even before TTD says that the email has been sent.

 

[jmoflhrc]

For what it is worth, my raspberry pi setup is 3-5 seconds from the done converting to Email Sent and about 7 seconds from the Done Recording to the Email Sent. This seems to be consistent regardless of whether there are 20 addresses in the list or 2.

My guess is that the delay you are seeing may be on the email provider's end. TTD has done its thing when the converting is done. There must be some sort of handshake that is done with the email provider confirming that the emails were sent. That may be taking a minute to complete. I use Gmail to send the TTD emails and to receive my alerts. Many times my phone is beeping even before TTD says that the email has been sent.

Thanks for the info. That's actually a good idea trying a different smtp gateway. I am starting to think it is that also. Tonight took about a minute with the same 40 person email list. Below are the end of the logs from the debug window during our 18:00 hour time test.

Waiting for Silence Darien Fire Department 17:58:53 on 03/09/14
Done recording Darien Fire Department 17:58:56 on 03/09/14
done writing WAV Darien Fire Department 17:58:56 on 03/09/14
ffmpeg version N-32726-ga254452, Copyright (c) 2000-2011 the FFmpeg developers
built on Sep 19 2011 19:49:13 with gcc 4.6.1
configuration: --enable-gpl --enable-version3 --enable-runtime-cpudetect --ena
ble-avisynth --enable-bzlib --enable-frei0r --enable-libopencore-amrnb --enable-
libopencore-amrwb --enable-libfreetype --enable-libgsm --enable-libmp3lame --ena
ble-libopenjpeg --enable-librtmp --enable-libschroedinger --enable-libspeex --en
able-libtheora --enable-libvo-aacenc --enable-libvo-amrwbenc --enable-libvorbis
--enable-libvpx --enable-libx264 --enable-libxavs --enable-libxvid --enable-zlib

libavutil 51. 16. 1 / 51. 16. 1
libavcodec 53. 16. 0 / 53. 16. 0
libavformat 53. 12. 0 / 53. 12. 0
libavdevice 53. 4. 0 / 53. 4. 0
libavfilter 2. 43. 2 / 2. 43. 2
libswscale 2. 1. 0 / 2. 1. 0
libpostproc 51. 2. 0 / 51. 2. 0
[wav @ 01BC8500] parser not found for codec pcm_s16le, packets or times may be i
nvalid.
[wav @ 01BC8500] max_analyze_duration 5000000 reached at 5015510
Input #0, wav, from './audio/Darien_Fire_Department_2014-03-0917_58_56_666000.wa
v':
Duration: 00:00:30.65, bitrate: 176 kb/s
Stream #0.0: Audio: pcm_s16le ([1][0][0][0] / 0x0001), 11025 Hz, 1 channels,
s16, 176 kb/s
[mp3 @ 01C1B0E0] Unsupported sample rate.
Output #0, mp3, to './audio/Darien_Fire_Department_2014-03-0917_58_56_666000.mp3
':
Metadata:
TSSE : Lavf53.12.0
Stream #0.0: Audio: mp3, 11025 Hz, 1 channels, s16, 64 kb/s
Stream mapping:
Stream #0.0 -> #0.0 (pcm_s16le -> libmp3lame)
Press [q] to stop, [?] for help
size= 240kB time=00:00:30.77 bitrate= 64.0kbits/s
video:0kB audio:240kB global headers:0kB muxing overhead 0.013405%
done converting to MP3 Darien Fire Department 17:58:57 on 03/09/14
MP3 Email sent! Darien Fire Department page received at 17:58:57 on 03/09/14 17:59:52 on 03/09/14

 

[jmoflhrc]

doing some tests with 1 email address tonight the email sent is instantly. I am leaning more to the email gateway of our hosting provider being slow. I have switched to use the email gateway of our ISP and will record the speed when the next call goes out to the whole group.

Thanks again for all the support here guys!

-Jason

 

[jmoflhrc]

I finally moved to a new email service today an things are so much faster. I was able to get the email to 56 people in seconds from after the mp3 conversion took place.

I'm not sure I like the hourly quota thing at the moment but the service is fast. As I have been sending more emails the quota has been going up so I think it will be ok.
https://mandrillapp.com/

-Jason

 

[engcogod]

I finally moved to a new email service today an things are so much faster. I was able to get the email to 56 people in seconds from after the mp3 conversion took place.

I'm not sure I like the hourly quota thing at the moment but the service is fast. As I have been sending more emails the quota has been going up so I think it will be ok.
https://mandrillapp.com/

-Jason

Jason, how did you get this to work with TTD? I signed up and got everything setup but the emails aren't sending and when I check the API error log on mandrill it says "reject_reason": "invalid-sender". I copied all the SMTP info over to TTD but I must be missing something else. I would love to get this working so people can get the dispatch a lot faster.