Portal Home > Knowledgebase > Industry Announcements > Web Hosting Main Forums > Providers and Network Outages and Updates > Paypal IPN Down [merged]
Paypal IPN Down [merged]
| Posted by WebsiteIntegrations, 01-28-2013, 04:20 AM |
UPDATE 1: We are experiencing an ongoing system issue which may be affecting Express Checkout, PayPal APIs, Virtual Terminal, and Website Payments Pro Payflow Edition (PayPal Payments Pro in US) on the Live Site.
Merchants may encounter 10001 - Internal error when processing API calls. We are working towards resolving the issue.
Sent Jan 27, 11:48 PM PST by SA
ORIGINAL NOTIFICATION: We are experiencing a system issue which may be affecting Express Checkout, PayPal APIs, Virtual Terminal, and Website Payments Pro Payflow Edition (PayPal Payments Pro in US) on the Live Site. We will send an update with additional details within the next 15-30 minutes.
Sent Jan 27, 11:15 PM PST by SA
https://www.x.com/content/update-1-m...e-payments-pro
-----------------
found out about this after trying to send a payment - receiver did not get money but it came out of my account. I then noticed a bunch of recent transactions are missing from my paypal account. |
| Posted by WebsiteIntegrations, 01-28-2013, 05:12 AM |
UPDATE 2: Our technical teams are continuing to actively troubleshoot the issue.
Please also note that users may not see recent transactions in the Account History. We will provide an update as soon as the issue is resolved. |
| Posted by WebsiteIntegrations, 01-28-2013, 06:46 AM |
|
RESOLVED: This issue has been resolved as of Jan 28, 1:50 AM PST (Jan 28, 9:50 AM GMT). |
| Posted by ceylonhost, 01-28-2013, 07:00 AM |
|
I',m not able to add payment to Resell.biz via PayPal, will that be the reason ? |
| Posted by ecvps, 01-28-2013, 09:13 AM |
i'm able to add payment to Resell.biz
but
Your payment has not yet been applied to your account. This could be because of any of the following reasons -
* The PayPal account you used to deposit your payment is an Unverified PayPal account. In this case our Billing Desk will manually check this payment before it is applied to your Reseller account. This may take upto 2 business days.
* You made a PayPal payment using an echeck. An echeck takes upto 4 business days to clear. As soon as the echeck clears your Payment will immediately reflect in your account.
* There maybe some other reason due to which PayPal has flagged the status of your payment as pending. In this case our Support desk will check your payment status and you will get an email from us within 3 business days confirming the same
Still waiting for their update. |
| Posted by AndyGambles, 01-28-2013, 09:18 AM |
|
IPN callbacks from PayPal are being delayed. This means the money may have been sent but PayPal has not notified the receiver via the IPN so they can process the order. This is happening for us and we are just having to manually process orders as they come in. |
| Posted by Kakashi, 01-28-2013, 09:25 AM |
Just a heads up that the Paypal IPN system is currently not operational. So any payments for invoices coming into Paypal aren't having IPN details being generated and sent to your Shopping cart systems. WHMCS in my case.
I just called Paypal Business support and got a confirmation it's a known issue and it's being worked on.
Was advised to keep a close eye on payments coming in and manual authorise them for now.
I am not sure on the scope of the issue, it might just be for Paypal UK. Their twitter account also confirms they've been having issues this morning: https://twitter.com/PayPalUK |
| Posted by evocart, 01-28-2013, 09:37 AM |
|
Yes this seem to be affecting a few sites, added funds to net earth one earlier and it had to be manually aproved and now I have clients saying they are getting orders and they are not showing up in the cart admin, even though payment has paid which I think may be due to the same issue as was working fine yesterday. |
| Posted by WII-Aaron, 01-28-2013, 09:45 AM |
|
I'm not seeing any issues in the US. Can anyone confirm that this is localized to the UK? |
| Posted by ZKuJoe, 01-28-2013, 09:46 AM |
|
I only see 2 orders from today in the IPN History with a handful we had to process manually. |
| Posted by Kakashi, 01-28-2013, 09:48 AM |
Quote:
|
Originally Posted by ZKuJoe
I only see 2 orders from today in the IPN History with a handful we had to process manually.
|
We had about 10-12 Invoices paid since this morning with only 2 that had an IPN generated for them. Rest had to be done manually. |
| Posted by ZKuJoe, 01-28-2013, 09:54 AM |
|
It does look random, but definitely not limited to the UK. |
| Posted by WII-Aaron, 01-28-2013, 10:02 AM |
|
We're still going through everything. We've had about 200 PayPal payments over the last 8 hours so this could be a pain in the ass if we have to go back and manually mark any if them. |
| Posted by NYCServers-Nick, 01-28-2013, 10:06 AM |
|
We had some invoices that were paid but our WHMCS showed them "unpaid" so the IPN issues are definitely effecting the USA as well. |
| Posted by mikeporemba, 01-28-2013, 10:07 AM |
I have received 3 payments today but there is no IPN message for that payments. I wrote email to paypal customer support with print screen of overview with payments and IPN history where IPN messages are missing, and so far no answer. I'm located in SK.
I see that paypal today changed website a little bit - maybe paypal made some bug in today's update. |
| Posted by EvolutionCrazy, 01-28-2013, 10:09 AM |
same issue here...
<sarcasm>
luckly paypal is the cheapest gateway out there...
Should we donate higher fees to them so they can put up better systems with higher uptime?
</sarcasm> |
| Posted by Time4VPS, 01-28-2013, 10:14 AM |
|
If you have issue with WHMCS and PayPal, contact WHMCS support. I have exact the same problem (WHMCS paypal gateway was not working correctly) and contacted them. Issue was resolved by the WHMCS. |
| Posted by ZKuJoe, 01-28-2013, 10:29 AM |
Quote:
|
Originally Posted by time4vps
If you have issue with WHMCS and PayPal, contact WHMCS support. I have exact the same problem (WHMCS paypal gateway was not working correctly) and contacted them. Issue was resolved by the WHMCS.
|
The problem is on Paypal's side, not WHMCS's. |
| Posted by Time4VPS, 01-28-2013, 10:31 AM |
Quote:
|
Originally Posted by ZKuJoe
The problem is on Paypal's side, not WHMCS's.
|
Maybe it's coincident issue, but very similar... |
| Posted by Kakashi, 01-28-2013, 10:32 AM |
Quote:
|
Originally Posted by time4vps
If you have issue with WHMCS and PayPal, contact WHMCS support. I have exact the same problem (WHMCS paypal gateway was not working correctly) and contacted them. Issue was resolved by the WHMCS.
|
That might be another issue. If you go to your Paypal profile and check the IPN history you will see that nothing is being generated. If there was an issue with WHMCS then it would have shown up as generated at least.
This is why I contacted Paypal and they've confirmed it.
Besides, haven't touched WHMCS in months and this problem mysteriously appeared this morning. |
| Posted by ZKuJoe, 01-28-2013, 10:34 AM |
Quote:
|
Originally Posted by time4vps
Maybe it's coincident issue, but very similar...
|
I don't see how any code in WHMCS would cause Paypal's service to not work. |
| Posted by DevMonkey, 01-28-2013, 10:36 AM |
|
I've also not been receiving IPN's here in the UK (I'm not running WHMCS either). |
| Posted by Time4VPS, 01-28-2013, 10:36 AM |
Quote:
|
Originally Posted by ZKuJoe
I don't see how any code in WHMCS would cause Paypal's service to not work.
|
Where do I mention that WHMCS code afected PayPal's IPN issues? I shared my last 3 days experience with WHMCS and PayPal IPN issues. As I said before: maybe it's coincident issue. |
| Posted by ZKuJoe, 01-28-2013, 10:40 AM |
Quote:
|
Originally Posted by time4vps
Where do I mention that WHMCS code afected PayPal's IPN issues? I shared my last 3 days experience with WHMCS and PayPal IPN issues. As I said before: maybe it's coincident issue.
|
You mentioned it here:
Quote:
|
Originally Posted by time4vps
If you have issue with WHMCS and PayPal, contact WHMCS support. I have exact the same problem (WHMCS paypal gateway was not working correctly) and contacted them. Issue was resolved by the WHMCS.
|
|
| Posted by WebHostDog, 01-28-2013, 10:44 AM |
|
PayPal just made our day ... |
| Posted by mikeporemba, 01-28-2013, 10:53 AM |
|
Confirmed. Answer from paypal: We would like to apologise for the inconvenience caused, this was due to a technical issue we were experiencing today and we can assure you that this has now been resolved. |
| Posted by Kakashi, 01-28-2013, 10:56 AM |
Quote:
|
Originally Posted by mikeporemba
Confirmed. Answer from paypal: We would like to apologise for the inconvenience caused, this was due to a technical issue we were experiencing today and we can assure you that this has now been resolved.
|
Just had another invoice paid about 5 minutes ago, and same issue. Don't think it's resolved but we'll see. |
| Posted by bdwebservices, 01-28-2013, 11:01 AM |
I paid to licensepal.com for new WHMCS license. But yet not receive key ans invoice status also Unpaid!  |
| Posted by yourwebhostereu, 01-28-2013, 11:02 AM |
|
I can confirm that the problem is still there. We're monitoring the Paypal transactions and processing them asap to get the orders processed. |
| Posted by IMOG, 01-28-2013, 11:04 AM |
Quote:
|
Originally Posted by Kakashi
Just had another invoice paid about 5 minutes ago, and same issue. Don't think it's resolved but we'll see.
|
Might take a little time, you know, like DNS propagation. No idea how they roll out changes, but they have a herd of boxen that the changes likely need to roll through. |
| Posted by Kevin Hillstrand, 01-28-2013, 11:13 AM |
|
Does anyone know if the IPN will eventually be created, I have been manually adding payments since the issue this morning and if the IPN eventually will be created, it will be detected as a "duplicate" payment by WHMCS and add credits for the user, I don't want to go through 150+ transactions I manually added today just to remove the credits. |
| Posted by Kakashi, 01-28-2013, 11:17 AM |
Quote:
|
Originally Posted by Kevin Hillstrand
Does anyone know if the IPN will eventually be created, I have been manually adding payments since the issue this morning and if the IPN eventually will be created, it will be detected as a "duplicate" payment by WHMCS and add credits for the user, I don't want to go through 150+ transactions I manually added today just to remove the credits.
|
Good point... Are you sure this is how WHMCS will behave ? Won't it detect an existing duplicate transaction ID already present and ignore it ? |
| Posted by Kevin Hillstrand, 01-28-2013, 11:24 AM |
Quote:
|
Originally Posted by Kakashi
Good point... Are you sure this is how WHMCS will behave ? Won't it detect an existing duplicate transaction ID already present and ignore it ?
|
Yes I am positive, I have been working with WHMCS for a while and it ADDS duplicate payments as account credit. |
| Posted by cd/home, 01-28-2013, 11:27 AM |
Our last experience of Paypal's IPN going down lasted some 72 hours.
Their jokers to say the least. |
| Posted by ceylonhost, 01-28-2013, 11:31 AM |
Quote:
|
Originally Posted by ecvps
i'm able to add payment to Resell.biz
but
Your payment has not yet been applied to your account. This could be because of any of the following reasons -
* The PayPal account you used to deposit your payment is an Unverified PayPal account. In this case our Billing Desk will manually check this payment before it is applied to your Reseller account. This may take upto 2 business days.
* You made a PayPal payment using an echeck. An echeck takes upto 4 business days to clear. As soon as the echeck clears your Payment will immediately reflect in your account.
* There maybe some other reason due to which PayPal has flagged the status of your payment as pending. In this case our Support desk will check your payment status and you will get an email from us within 3 business days confirming the same
Still waiting for their update.
|
Correct. This is the same issue I'm having. Happened to last 3 transactions. |
| Posted by Kakashi, 01-28-2013, 11:32 AM |
Quote:
|
Originally Posted by Kevin Hillstrand
Yes I am positive, I have been working with WHMCS for a while and it ADDS duplicate payments as account credit.
|
I better start noting down the ones I process manually then -_____- |
| Posted by Dan_EZPZ, 01-28-2013, 11:35 AM |
|
If you enter the transaction ID when adding the payment to WHMCS it won't add the duplicate so account credit wouldn't be applied. |
| Posted by zenofo, 01-28-2013, 11:53 AM |
Same problem, still "Unpaid",
what can I do now? ticket provider ot just waiting? |
| Posted by cd/home, 01-28-2013, 12:06 PM |
Quote:
|
Originally Posted by zenofo
Same problem, still "Unpaid",
what can I do now? ticket provider ot just waiting?
|
Just do a reconciliation between your WHMCS - Paypal then manually mark any payments within WHMCS as needed. |
| Posted by WebHostDog, 01-28-2013, 12:07 PM |
|
Always adding the PayPal transaction ID when adding payment so hope to be fine after this mess. |
| Posted by Kevin Hillstrand, 01-28-2013, 12:17 PM |
Quote:
|
Originally Posted by Dan_EZPZ
If you enter the transaction ID when adding the payment to WHMCS it won't add the duplicate so account credit wouldn't be applied.
|
Quote:
|
Originally Posted by WebHostDog
Always adding the PayPal transaction ID when adding payment so hope to be fine after this mess.
|
Thanks! I've been doing that today, but just wanted to make sure as I experienced in the past that it would add duplicates as account credit. That was probably because I didn't add transaction IDs back then though.
Hopefully PayPal will sort this ordeal shortly as it is impacting a lot of companies even outside of hosting. |
| Posted by cd/home, 01-28-2013, 12:19 PM |
Quote:
|
Originally Posted by Kevin Hillstrand
Hopefully PayPal will sort this ordeal shortly
|
Whenever has Paypal done anything shortly  |
| Posted by LP-Jay, 01-28-2013, 12:23 PM |
Quote:
|
Originally Posted by bdwebservices
I paid to licensepal.com for new WHMCS license. But yet not receive key ans invoice status also Unpaid!
|
Yup, PayPal IPN is not working for us. Interestingly, it only affects regular payments and not subscriptions payments or PayPal Pro payments.
Bit of a pain having to keep checking the payments history, hope they sort this quickly. |
| Posted by Stylex Networks, 01-28-2013, 12:34 PM |
|
Well this makes perfect sense. We are experiencing the same issues, we thought it was HostBill. |
| Posted by TravisT-[SSS], 01-28-2013, 01:06 PM |
|
We actually found orders that were missed because of this. Had to apologize for the late response. Felt bad that we left them hanging with no updates on their order. ;/ |
| Posted by ViperNet, 01-28-2013, 01:18 PM |
|
This issue, is resolved now? |
| Posted by BuycPanel-Jeff, 01-28-2013, 01:27 PM |
ViperHostNet,
No, it appears that the issue is still occurring. Latest update from PayPal executive support, is that they will have another update in 30 minutes (from now). |
| Posted by IMOG, 01-28-2013, 02:07 PM |
1PM EST Update: There is no update. They continue to work on the problem.
Next Update? 3PM EST |
| Posted by cd/home, 01-28-2013, 02:18 PM |
Quote:
|
Originally Posted by IMOG
1PM EST Update: There is no update. They continue to work on the problem.
Next Update? 3PM EST
|
It'll be fixed when it's fixed last time it took them days for our IPN to work correctly again. |
| Posted by Flapadar, 01-28-2013, 02:22 PM |
We're seeing IPN_START, and then immediately after IPN_HANDSHAKE_INVALID
Been getting it intermittently for a few days / a week or so now. |
| Posted by WebsiteIntegrations, 01-28-2013, 04:26 PM |
|
wow this is still going on |
| Posted by TravisT-[SSS], 01-28-2013, 04:28 PM |
Latest update:
Quote:
UPDATE 4: Our technical teams are fully engaged and are actively working on a resolution. While we have observed some marginal improvement in IPN delivery, the majority of IPNs are still delayed. We will provide next update by Jan 28, 2:00 PM PST (Jan 28, 10:00 PM GMT) or sooner if there is a change of status.
Sent Jan 28, 11:57 AM PST by SC
|
|
| Posted by Martin-D, 01-28-2013, 04:29 PM |
|
Just recieved a few IPN's so it might be working for some. |
| Posted by AndyGambles, 01-28-2013, 04:43 PM |
|
Our IPN's have started to trickle through but backwards with the most recent first. |
| Posted by WebsiteIntegrations, 01-28-2013, 05:11 PM |
|
and to top it off - if your in Canada there is now also an issue with Visa (not paypal related - meaning Visa cards are not working anywhere!) |
| Posted by kaniini, 01-28-2013, 06:26 PM |
here's a glitch i have noticed since yesterday...
we were getting IPNs delivered to our CRM system, but when our CRM system would verify the IPN, it would come back "INVALID". prior to yesterday, everything was working OK.
do you think this is related? |
| Posted by TravisT-[SSS], 01-28-2013, 06:38 PM |
Just to help make people aware:
Quote:
UPDATE 5: We have implemented a fix and IPNs for transactions processed after Jan 28, 10:47 AM PST (Jan 28, 6:47 PM GMT) are being sent now. We are expecting IPNs for new transactions to start being delivered in near real-time within the next hour. We are also estimating that missing IPNs for transactions processed between Jan 27, 11:04 PM PST (Jan 28, 7:04 AM GMT) and Jan 28, 10:47 AM PST (Jan 28, 6:47 PM GMT) will be delivered within the next 24 hours.
We will provide the next update by Jan 28, 3:30 PM PST (Jan 28, 11:30 PM GMT).
|
|
| Posted by cd/home, 01-28-2013, 07:07 PM |
|
Our IPN notifications have come through now after what a 24 hour outage... |
| Posted by WingedHosting-Ben, 01-29-2013, 01:55 PM |
|
I dont see any problems here in the us. |
| Posted by stablehost, 01-29-2013, 02:21 PM |
|
It's been resolved. |
| Posted by AndyGambles, 01-29-2013, 04:46 PM |
Quote:
|
Originally Posted by stablehost
It's been resolved.
|
WooHoo  |
| Posted by ceylonhost, 01-30-2013, 06:43 AM |
Is this new issue or part of the same ?
Code:
TRANSACTION INFORMATION
We wanted to take this opportunity to personally explain to you a situation that occurred with one of your recent transactions.
We had a technical issue for three hours on January 27 and 28 that impacted you. This technical issue caused a payment you sent from your PayPal account to be duplicated, which means you paid more than once for the same transaction. We sincerely apologise for this issue and are working around the clock to make it right as soon as possible.
We have reversed the erroneous transaction back to your PayPal account or credit card. If the duplicate transaction came from your bank account, we have placed the funds back in your PayPal account balance and are working today to move them back to your bank account.
If you have any questions, or if this issue caused you to incur any fees or charges from either your credit card or bank account, please contact us.
Customers are PayPals top priority. We appreciate your understanding and patience as we get this situation resolved.
Sincerely,
PayPal
|
| Posted by WebsiteIntegrations, 01-30-2013, 06:54 PM |
|
the same, I got that email because i ended up making a double payment of something due to their issues and they refunded one of the payments. |
| Posted by Saket, 02-09-2013, 09:24 AM |
Is anybody facing the problem of delayed mails?
For example: A withdrawal is done for the paypal account but the acknowledgement mail comes after 48 hours or so. |
| Posted by ReliableNode, 02-09-2013, 01:02 PM |
Quote:
|
Originally Posted by Saket
Is anybody facing the problem of delayed mails?
For example: A withdrawal is done for the paypal account but the acknowledgement mail comes after 48 hours or so.
|
PayPal mentioned that there will be maintenance today. |
| Posted by ViperNet, 02-09-2013, 02:59 PM |
Quote:
|
Originally Posted by Saket
Is anybody facing the problem of delayed mails?
For example: A withdrawal is done for the paypal account but the acknowledgement mail comes after 48 hours or so.
|
I just received a payment 3 minutes ago via paypal .. and I received email from paypal instant |
| Posted by Orien, 02-09-2013, 03:37 PM |
Quote:
|
Originally Posted by Saket
Is anybody facing the problem of delayed mails?
For example: A withdrawal is done for the paypal account but the acknowledgement mail comes after 48 hours or so.
|
Yep, delayed emails for the past few days. I got Feb 6 emails just yesterday. |
| Posted by SnowFalls, 02-09-2013, 09:40 PM |
Quote:
|
Originally Posted by NYCServers-Nick
We had some invoices that were paid but our WHMCS showed them "unpaid" so the IPN issues are definitely effecting the USA as well.
|
Had the same issue, although it seems to have been resolved.... good news. |
Add to Favourites 
Print this Article
Also Read
Shared Hosting
Shared Hosting
