Forums » Announcements Search

We are working on a more formal notification process to notify you of outages and issues. Until then, I shall be posting information about outages here (unless, of course, the problem is that the forum is offline).

Paul

Outage:

The developer forums were offline Sunday evening 3/8 an into the early morning of 3/9 due to a disk capacity overflow on the forum database server. This has been fixed and more disk space is being added.

Thanks, Paul!

Hey all:

Planned Service outage

Methods affected: get_top_hottt_artists, get_hotttnesss Duration: 36 hours

We are performing a large scale data ingestion and database upgrade. As a result, our two 'hotttnesss' related calls: get_top_hottt_artists and get_hotttnesss will be unavailable until the ingestion is complete. We expect this to take 1 or 2 days. Full service should be restored by late March 13. If you call these methods you will receive a return status of 'service unavailable'.

Apologies for any inconvenience.

Paul

Hey all:

Planned service outage

The remix api upload will be offline for about 5 minutes starting at 11:05 AM ET Monday 3/30 for about 5 minutes.

Paul

Hey all:

The remix upload is back online. Let the donking continue!

Paul

We had an unplanned outage of the developer APIs this morning. There's a bug that needs quashing. Apologies. Everything is back on line now.

Paul

Hey all:

We've restored the methods for retrieving news, reviews and blogs. The quality of the results should be improved as well.

Paul

We had an unplanned outage of the developer site and APIs this morning. Things are back online now. The problem was isolated to our internal queuing mechanism which has been restarted. The engineers are doing a post-mortem now to make sure that it doesn't happen again.

Apologies for the outage.

Paul

Hey all:

We are currently experiencing some reduced functionality for the web services. Some requests for certain artists may fail to be serviced. Full functionality shall be restored soon. Apologies for the inconvenience.

Paul

Things are back up and running at 100%. Back to work everyone.

Paul

hey all:

We are updating the web services today. Minor bug fixes and performance improvements. You probably won't notice anything different, but if you do notice anything, especially anything bad, let me know.

Paul

What would a software upgrade be if it didn't have a few glitches? Our logs are showing that a small number of web service requests are failing when they shouldn't be. We are taking a look. If this seems to be an ongoing problem, we'll roll back to the previous version. I'll keep you posted.

Paul

We had a short outage this afternoon. Some gremlins in the closet. Everything is back up. Apologies

Paul

Hey Echo Nest developers:

We are performing some maintenance on our data. During this period, some of our APIs will be offline. Methods affected are: feeds, get_news, get_blogs, get_reviews

Paul

Hey all:

We are seeing very slow track analysis times this morning. We'll restore full speed as soon as possible.

Paul

Hey all:

Thanks for your patience - track analysis is now back online at 100%.

Paul

Is the problem back? Everything I upload never makes it past PENDING.

Ryan

ryan:

Yes, things are working now. We had a short stall in the analysis queues and that leads to backlog so analyze make take longer than usual, but they should be getting through.

Paul

Thanks, Paul.

Ladies, Gentleman:

We are having some infrastructure troubles today so our analyze function is currently offline. If you are using the trackUpload method you will experience errors (http response code 500). I'll let you know when things are back online.

Paul

Hey all, analyze is now online again. Apologies for the outage. Back to remix.

Paul

Hey all:

We are experience some down time on our APIs. We are working to restore full operation ASAP.

Paul

Hey all:

Service is restored, apologies for the outage. We had a database corruption that took us a little bit of time to recover from.

Paul

Hi there - we apologize for the current outage, server maintenance is taking a little bit longer than we planned, we will be back shortly.

and we are back on line ... Thank you very much for your patience.

the track upload / analyze is currently offline. Should be restored soon. Apologies for the trouble.

he track upload / analyze is running again.

The analyzer is offline for a few minutes while we tend to our p's and queues. All should be restored soon.

Paul

The analyzer is back to analyzing, but we're still conducting maintenance. Thanks for your patience.

If your tracks seem unreasonably slow to analyze this weekend, let us know.

Hey all:

The developer APIs will be partially offline for 20 minutes starting at Noon ET today.

Paul

Hey All: APIs are restored.

Paul

We are going to be doing one more round of maintenance at 2PM ET today. You'll perhaps see a limited partial outage for about 20 minutes.

Paul

all services are now 100% operational.

Paul

All APIs are currently unavailable while we perform some unscheduled maintenance.

we are back to normal mode of the operations, sorry about the outage

There will be some intermittent API outages over the next hour or so while we upgrade some infrastructure.

Paul

There will be some intermittent API outages over the next hour or so while we continue to upgrade the infrastructure. We'll keep you posted on our status. Sorry for any inconvenience it might have caused

Yury

As you may have noticed (hopefully not) part of the API links is very slow now - this is because we are in the final (hopefully) leg of copying our data to a new server. We apologize profusely for any inconvenience it may have caused. We chose what we believe to be the slowest time of the year for this move and hope that the impact is minimal. We are trying to have the whole thing done by 9 am EST on December 30-th. Thank you very much for your patience!

All systems are back to normal now, we will let you know if there are any further outages needed. Thank you very much for your patience.

Hey all:

We are experiencing a partial outage of some of the API methods. Full operation should be restored soon.

Paul

Full operation of the APIs has been restored.

Paul

Hey all:

We are experiencing a partial outage of some of the APIs. Full operation should be restored soon.

Paul

Full operation of the APIs has been restored.

Paul

Hey all:

We are undergoing a temporary outage for trackUploads. We are looking at the issue. Full operation should be restored soon.

Paul

Full operation of the APIs has been restored.

Tyler

We are experiencing some degraded service for some of the artist api methods. Certain data may not be available for all artists. We are working to restore full operation. I'll let you know when full service is restored.

Paul

All artist data has been restored. - Paul

Temporary API outage. We are working to restore full service.

Paul

Full service has been restored. Sorry for the outage. - Paul

Temporary API outage. We are working to restore full service.

Paul

Full service has been restored. Sorry for the outage. - Paul

We will be performing some maintenance in the early morning hours of November 3. During that time certain services will be offline including artist search, news, reviews, and hotttnesss. The maintenance will occur shortly after midnight EDT, and will take between 15 and 20 minutes.

Paul

Tonight's maintenance has been completed.

Ryan

We are performing maintenance tonight from 10 PM until 1 AM EDT. During this time, catalog updates and analysis will not be available.

The maintenance is complete. All APIs are again operational.

Ryan

Dear Echo Nest API users, we will be performing a very short maintenance today at noon. APIs will be down for a period of time that should be no longer than 10 min long and is very likely to be much shorter than that. Another possible similar outage is scheduled at 3 pm, we will be posting again about it. Thank you so much, Yury

Dear Echo Nest API users, we completed the first leg of the maintenance at noon with 3 min of partial service interruption. We will run another one at 3pm. Service interruption will not exceed 5 min. Thank you very much for your patience. --Yury

Dear Echo Nest API users, we rescheduled yesterday's maintenance to 12 pm today, the outage will last under 5 min. We apologize for any inconvenience it may cause. Thank you very much. --Yury

Hey Echo Nest developers:

Over the next 24 hours you may experience some missing results for song related queries. Symptoms will include song/search calls that return fewer results than you requested, or song/profile results that return no info. Apologies for any trouble this may cause.

Paul

We are experiencing a partial outage of the APIs. In particular, some song related queries may fail. We are working on restoring full service.

Paul

Hey all - full API service has been restored. Sorry for the troubles.

Paul

We are experiencing a partial API outage. Full service will be restored soon.

Paul

API service is restored. - Paul

We are experiencing a partial API outage. Full service will be restored soon.

Paul

Update on the outage. Full service of the APIs have been restored. We will be performing some more maintenance this morning as we clean up the bucket of bits that fell on the floor. You may see a minor outage or performance degradation until everything is swept up.

Paul

The API seems to be down at the minute!

Hi J03,

Thanks for the update. we had our monitors report as well. We've isolated the issue and it should now be resolved. Thanks for the heads up!

Is the API operational?

Chris - yes. Are you seeing any specific troubles? -- paul

I was seeing very slow response times while uploading new tracks, to the point of thinking I was getting no response. But in the last couple minutes it seems to have returned to typical behavior. Sorry for the bother.

no worries, chris.

Hey Developers - we are experiencing a minor database issue this afternoon. A small percentage (about 1%) of artists have decided to disappear from our datastore. If you try to get data for one of these artists you will receive an error 'the identifier specified does not exist'. We are working to restore the data and expect to be back to 100% in about 2 hours. Sorry for the disturbance.

Paul

Dear Echo Nest API developers, we restored the data missing and now are resuming our normal operations. We apologize for any inconvenience it might have caused. Fantastically yours, EN development team

We are experiencing a temporary API outage. Full operation will be restored as soon as possible.

Paul

Hey all - full functionality has been restored. Apologies for the outage -- Paul

Forums & account details are now restored. Thank you

Hey all - we are seeing an outage on personal catalog updates. We are working to get things online ASAP. -- Paul

Hey all - Personal Catalog APIs are restored. Sorry for the trouble. -- Paul

We are experiencing a partial outage. Our song/search and song/profile methods are currently failing. We are working to restore service. I'll let you know as soon as full service has been restored. -- Paul

Full API service has been restored. Apologies for the outage. -- Paul

Hey all - we are experiencing an API outage. We are working on restoring it. -- Paul

Full API service has been restored. Apologies for the outage. -- Paul

Hey all - we are experiencing some delays and failures with our artist/search api. We will let you know when full service is restored. -- Paul

Hey all - we are experiencing some delays and failures with our artist/search api. We will let you know when full service is restored. -- Paul

artist search is restored with some slightly compromised behavior. Not all artist aliases may be recognized. -- Paul

Hey all - we are experiencing a temporary outage for track uploads/analysis. We are working to get things back online. We'll let you know when things are back to normal. -- Paul

Full API service has been restored. Apologies for the outage. -- Paul

We are experiencing a failure of the Echo Nest API. The catalog API calls are currently responding with intermittent timeouts, but all other calls appear to be working correctly. We're working to understand the issue now and will provide additional information as we have it. -- Paul

Full API service has been restored. Apologies for the outage. -- Paul

Hey all - we had an errant News Indexer Malfunction over night that resulted an many older news stories receiving today's timestamp. This means that our artist/news API is serving up old news stories as fresh. For example this query for Britney Spear's is now returning news from 2009:

http://developer.echonest.com/api/v4/artist/news?api_key=N6E4NIOVYMTHNDM8J&name=britney+spears&format=json&results=10&start=0

We are working to restore the proper dates to our news articles. The most popular artists should be restored today and the rest should be fixed within a few days. Sorry for the trouble. -- Paul

Another status update on the news issue - since all of the offending old news stories have a timestamp of yesterday or today, we've temporarily patched our API so that it will avoid news stories with yesterday or today's timestamp. This means that the API will no longer serve 3 year old stories as 'news', but the downside is that the newest news it will serve will be two days old. Once we have the bulk of the data repaired we'll disable this patch and start to serve up fresh news again. -- Paul

Hey all,

We are experiencing a failure of the Echo Nest API. The track upload and analyze API calls are currently failing intermittently, but other calls appear to be working correctly. We're working to understand the issue now and will provide additional information as we have it.

We apologize for the interruption.

The Echo Nest

Hey all - Services have been restored. Apologies for the outage. -- Paul

Hey all: we are experiencing a temporary outage of some of our catalog services. We are investigating the issue and shall let you know when services are restored. -- Paul

Hey everyone: catalog services have been fully restored. Thanks for your patience.

Hey all, we are performing maintenance on a backing store that will take down track/upload for a couple of hours. This work will start now and we'll update you here.

Also, new artist and song data (feeds, biographies, etc) will not be refreshed during this maintenance window. New data will appear right after the window ends.

Thanks as always!

Everything is all clear. Thanks!

Hey all:

The artist/audio call is currently returning partial results. Artist and song title are missing and the origin link is truncated to 32 characters. The full response should be restored in the next 6 hours. -- Paul

The catalog/update method is currently having some trouble. We will update the status here.

The issue appears to have been network related. The problems seem to now be resolved.
Sorry for any inconvenience.

We are looking into an issue with songs queries which started having an issue at 12:48 UTC. We believe to have fixed the issue at 13:20 UTC and are looking into the cause. We will respond within 1 day with more information.

Sorry for any inconvenience

Hey developers. Here's a follow up to the issue we had yesterday with slow song queries. The problem was triggered by a set of of internal systems putting an undue load on our songs infrastructure, leading to the reduced performance. We've identified the bottleneck and have made adjustments to eliminate the problem. Full songs performance has been restored and the issue that led to the problem has been eliminated. -- Paul

Dear Echo Nest API users, we are currently experiencing an outage of catalogs (Taste Profiles) API - we expect it to be back up shortly. We apologize for any inconvenience it is causing. --Yury

And we are back ... All clear, catalogs API is up and running - thank you for your patience. Best Regards, --Yury

Hey All,

We're experiencing some issues with email registration. We'll let you know when things get back to normal.

And email registration is back. Thanks for your patience!

Looks like we're having some issues with our artist/search calls. We'll let you know when things are normal.

We're still diagnosing the issue. We'll keep you updated as we make progress.

and we're back! Thanks for your patience.

Dear Developers, we are having some issues with API calls taking name of an artist as an input. We are working on this issue and will keep you posted.

All good now, however we are still running diagnostics.

Dear Developers, our track upload/analyze APIs are temporarily out, they will be restored shortly - sorry about the inconvenience. We will let you know as soon as they are restored

track APIs are back in action, thank you for your patience.

Hey all - we just started experiencing some slow API response times. We are looking into it. -- Paul

And we are back to normal. -- Paul

Hey Developers,

We're seeing some issues with track/upload and track/profile calls for newly uploaded tracks. We're taking a look and will let you know when things return to normal.

Thanks!

Developers,

The issues with track/upload and track/profile have been resolved. Some tracks uploaded earlier today may not return valid analysis URLs via track/profile. Upload again or call track/analyze to refresh this data.

We apologize for any inconvenience.

Hi All,

We are currently experience some intermittent data quality issues. We are working to understand the issue now and will provide additional information as we have it. We apologize for the interruption. -- Paul

Hi, we've cleared up quality issues with the artist/images call and are working to ensure everything is OK with artist/similar and playlist/* calls.

hey all - we are experiencing some partial API outages. We are working on it. More info as soon as we know it. -- Paul

Hey all - everything is all clear now, sorry for the trouble. -- Paul

track/upload api is currently giving me this response:

{ "response": { "status": { "version": "4.2", "code": 6, "message": "The request was valid but we could not complete it" } } }

Are you guys still experiencing outages?

indiloop (and All),

track/upload is currently experiencing intermittent failures. If the track/upload call succeeds, call track/profile to get the analysis results once the status shows "complete". If you receive an error or the track status gets stuck in "pending", please try your upload again.

We will report back here when this is cleared up.

Thanks for your patience. ~David

Sounds good, thanks for the quick response!

All,

track/upload should be fully operational again. Sorry for the interruption.

Thanks for using The Echo Nest.

~David

Hey all:

We are currently experiencing a partial outage of our API. Artist search and playlisting are affected by this outage. We are working hard to resolve the issue now and will provide additional information as we have it.

We apologize for the interruption.

-- Paul

Service has been restored. Once again, we apologize for the outage. -- Paul

site is timing out, and only about 10% pings returned.

followup, its all good, no issues now. I realize now that it was probably a lot of people on the net right then.