SOLVED GV stopped connecting today

ariban

Member
Joined
Aug 1, 2013
Messages
310
Reaction score
16
I have been using piaf green for the past many years running centos 6.5, today all of a sudden. all my google voice trunks using motif just stopped working, they are disconnected and wont connect.
i logged into my gv account to make sure its not asking me for a security question, the allow less protected apps is allowed in google security. i dont know what is happening nor how to fix it, anyone else seeing this issue?

Asterisk = ONLINE | Dahdi = ONLINE | MySQL = ONLINE │
│ SSH = ONLINE | Apache = ONLINE | Iptables = ONLINE │
│ Fail2ban = ONLINE | Internet = ONLINE | Ip6Tables = ONLINE │
│ Disk Free = ADEQUATE| Mem Free = ADEQUATE| NTPD = ONLINE │
│ SendMail = ONLINE | Samba = OFFLINE | Webmin = ONLINE │
│ Ethernet0 = ONLINE | Ethernet1 = N/A | Wlan0 = N/A │
│ │
│ PIAF Installed Version = 3.0.6.5 under *HARDWARE* │
│ FreePBX Version = 2.11.0.43 │
│ Running Asterisk Version = 11.12.0 │
│ Asterisk Source Version = 11.12.0 │
│ Dahdi Source Version = 2.10.0 │
│ Libpri Source Version = 1.4.15 │
│ IP Address = 192.168.1.10 on eth0 │
│ Operating System = CentOS release 6.5 (Final) >< │
│ Kernel Version = 2.6.32-431.29.2.el6.i686 - 32 Bit │
│ Incredible Version = 11.10
 

ariban

Member
Joined
Aug 1, 2013
Messages
310
Reaction score
16
logs show this:
2016-05-22 21:51:17] WARNING[8948] res_xmpp.c: Parsing failure: Hook returned an error.
[2016-05-22 21:51:17] WARNING[8948] res_xmpp.c: JABBER: socket read error
[2016-05-22 21:51:17] ERROR[8949] res_xmpp.c: TLS connection for client 'gfaxgmailcom' cannot be established. OpenSSL initialization failed.
 

billsimon

Well-Known Member
Joined
Jan 2, 2011
Messages
1,534
Reaction score
727
logs show this:
2016-05-22 21:51:17] WARNING[8948] res_xmpp.c: Parsing failure: Hook returned an error.
[2016-05-22 21:51:17] WARNING[8948] res_xmpp.c: JABBER: socket read error
[2016-05-22 21:51:17] ERROR[8949] res_xmpp.c: TLS connection for client 'gfaxgmailcom' cannot be established. OpenSSL initialization failed.
Turn on xmpp debugging and find the error. If it is a tls compatibility error you might need to upgrade OpenSSL.
 

ariban

Member
Joined
Aug 1, 2013
Messages
310
Reaction score
16
so funny, this morning just started working again by itself!!
 

JRoque

Member
Joined
Jun 2, 2008
Messages
40
Reaction score
1
Hi. Same error here that started a few days ago. Each trunk would get into an endless loop of failures and retries with the above message printed to the log. I ended up deleting all of my GVoice trunks as they overwhelmed by router, hitting the 4,096 max number of outbound connections. I also received a couple of "unusual activity" warnings from Google search that I suspect were tied to the high number of failed TLS connections.

My OpenSSL and related packages are up to date. My impression was that it could have been related to an unsupported TLS cypher of sorts. If it's now working again for some, it might have been something on Google's side. I will try adding the trunks back in later today and see if its better.

Thanks,
JR
 

JRoque

Member
Joined
Jun 2, 2008
Messages
40
Reaction score
1
Hi all. Ok after enduring a few days of TLS related issues on my GVoice trunks, everything's working again now. I had not made any changes before and no changes were made since the last time they were failing. All GVoice trunks are now up and running.
Thanks,
JR
 

JRoque

Member
Joined
Jun 2, 2008
Messages
40
Reaction score
1
Anyone else started seeing the same SSL issue again since last night? I wish Jabber had a retry time setting instead of flooding it repeatedly when it can't connect.
Thanks,
JR
 

yozh

Member
Joined
Nov 9, 2010
Messages
71
Reaction score
3
Started seeing this last night.

Code:
[2016-06-14 07:25:38] ERROR[4411]: res_xmpp.c:2560xmpp_client_requested_tls: TLS connection for client 'XXXXX' cannot be established. OpenSSL initialization failed.

[2016-06-14 07:25:38] WARNING[4411]: res_xmpp.c:3527xmpp_client_receive: Parsing failure: Hook returned an error.

[2016-06-14 07:25:38] WARNING[4411]: res_xmpp.c:3586xmpp_client_thread: JABBER: socket read error

So it just starts working after a while ? I have few trunks and this kills the vm and strains the firewall like crazy... I checked google accounts and they are working, updating all the packages on the box. Seems that all acounts are doing it, not just certain ones.
 

JRoque

Member
Joined
Jun 2, 2008
Messages
40
Reaction score
1
Yes, Jabber goes into a loop of reconnects and uses up every available connection socket until the firewall/router maxes out. If Jabber had a timeout or delay between connects, it would just fail to connect but not bring down everything around with it. I finally deleted all of my GVoice trunks. It's been a nice few years run but it's is now getting way too unstable.
Thanks,
JR
 

billsimon

Well-Known Member
Joined
Jan 2, 2011
Messages
1,534
Reaction score
727
Could someone grab XMPP debugs of this while it is happening? It would be useful to see what is actually being exchanged with Google during this thrashing.
 

yozh

Member
Joined
Nov 9, 2010
Messages
71
Reaction score
3
Yes, Jabber goes into a loop of reconnects and uses up every available connection socket until the firewall/router maxes out. If Jabber had a timeout or delay between connects, it would just fail to connect but not bring down everything around with it. I finally deleted all of my GVoice trunks. It's been a nice few years run but it's is now getting way too unstable.
Thanks,
JR

Too bad you deleted, wanted to know if its happening to you as well right now.

It'll be intresting to know if its happening to all at the same time.

Im really hopping this will fix it self soon, if not I might be in the same boat and delete voice trunks via xmpp maybe go with the $5 solution, just I have few trunks.
 

yozh

Member
Joined
Nov 9, 2010
Messages
71
Reaction score
3
Could someone grab XMPP debugs of this while it is happening? It would be useful to see what is actually being exchanged with Google during this thrashing.
As soon as I get in, I can try that, just set debug=yes in xmpp.conf ?
 

billsimon

Well-Known Member
Joined
Jan 2, 2011
Messages
1,534
Reaction score
727
As soon as I get in, I can try that, just set debug=yes in xmpp.conf ?

No, do it from the Asterisk console. "xmpp set debug on" or similar - wait a little while - then turn it back off. You'll find the debugs in the full log.
 

yozh

Member
Joined
Nov 9, 2010
Messages
71
Reaction score
3
No, do it from the Asterisk console. "xmpp set debug on" or similar - wait a little while - then turn it back off. You'll find the debugs in the full log.
The console is over run with the messages I posted above, Ill try to do it from the console and post it here.
 

tycho

Guru (not...)
Joined
Aug 9, 2011
Messages
652
Reaction score
272
@billsimon, I have a set-up with multiple GV trunks. I'll go turn on debugging as well to see what surfaces...

(I wouldn't have noticed there was a problem. I don't use those trunks, or even that PBX, often. I still primarily use GV from an Obi100 when at home, and your gateway via Zoiper when on the road...)
 

yozh

Member
Joined
Nov 9, 2010
Messages
71
Reaction score
3
(I wouldn't have noticed there was a problem. I don't use those trunks, or even that PBX, often. I still primarily use GV from an Obi100 when at home, and your gateway via Zoiper when on the road...)
You use what with Zoiper ?
 

billsimon

Well-Known Member
Joined
Jan 2, 2011
Messages
1,534
Reaction score
727
So I have the log. In less then a minute I have a 3.1mb log with about 36000 lines...

https://www.zerobin.net/?a06e3fc8d657e57a#k1+vzs8oekbb5bP3ZpdFFbBU0H4huIazfPU95KfQAI8=

There is a bug report that matches this: https://issues.asterisk.org/jira/browse/ASTERISK-24712

There are four possible paths in this function that lead to the error message you are getting. http://doxygen.asterisk.org/trunk/dc/d6b/res__xmpp_8c.html#061c4cbf39cf2ba5a8d8175f2a6716ee

It seems like an OpenSSL compatibility problem.

What version of OpenSSL are you running?
 

Members online

Forum statistics

Threads
25,779
Messages
167,505
Members
19,199
Latest member
leocipriano
Get 3CX - Absolutely Free!

Link up your team and customers Phone System Live Chat Video Conferencing

Hosted or Self-managed. Up to 10 users free forever. No credit card. Try risk free.

3CX
A 3CX Account with that email already exists. You will be redirected to the Customer Portal to sign in or reset your password if you've forgotten it.
Top