Quantcast
Channel: The most updated car database
Viewing all articles
Browse latest Browse all 126

Second American car database

$
0
0

Database starts at 1990 with model naming and prices, but specifications are available starting from 1996. Last release: 14 June 2019, including 2744 models of MY 2019 and 645 of MY 2020.

Download free SAMPLES:
American-Car-Database-No-Specs-by-Teoalida-SAMPLE.xls (5 columns)
American-Car-Database-Basic-Specs-by-Teoalida-SAMPLE.xls (28 columns)
American-Car-Database-Full-Specs-by-Teoalida-SAMPLE.xls (210 columns)

Buy complete database + FREE updates for one year:

Description

I offered a car database for USA market since 2014, named Year-Make-Model-Trim-Specs, but it does not have several things that some customers were looking for, for example MSRP (manufacturer’s suggested retail price) until April 2018 update.

I discovered TheCarConnection in October 2017 when a customer interested in MSRP suggested me to do scraping from this website to sell him a database with car prices, then in November 2017 another customer asked me for specific technical specs so I offered to sell him same database, re-scraped to include all specifications. After selling privately to 2 customers, both interested in 2017-2018 models only, I decided to scrap all 1990-2018 models and publish database on website so everyone can purchase.

Accuracy notes

If you care about accuracy you are advised to buy Year-Make-Model-Trim-Specs (the first American car database I made, based on Edmunds.com), unless you need certain data available only in the 230 columns package of the Second American Car Database.

Second American car database, based on TheCarConnection.com, is sold “as it is” without corrections or additions, because any changes done will be lost at next update. While specifications for each individual car are pretty accurate, filtering cars of a specific class may be a trouble, because it contains multiple values having same meaning: “midsize car”, “midsize cars”, “mid-size cars”. Model hierarchy was slightly messed, for example Jetta is 1996-2005, 2009-2014, 2017-2018, New Jetta is 1999, Jetta Sedan 2002-2016, etc (they corrected this mess in mid-2019).

Second American car database lacked a constant unique ID (until mid-2019) and they have a habit to change URLs of old cars, merging cars with too similar specs thus deleting some,  etc. In mid-2019 they deleted nameplates discontinued before 2015 (details below). This makes me worried about certain customers who integrate other data with my database, I am not sure if these changes pose them a problem on long term…

Year-Make-Model-Trim-Specs beside nearly perfect specs accuracy, I manually-built URLs of car models with unique IDs thus it is constant over time and nothing is delete. I also improved model hierarchy, corrected errors and added additional data not included in the original website.

List of car makes

Acura, Alfa Romeo, AM General, Aston Martin, Audi, Bentley, BMW, Buick, Cadillac, Chevrolet, Chrysler, Coda, Daewoo, Dodge, Eagle, Ferrari, FIAT, Fisker, Ford, Genesis, Geo, GMC, Honda, HUMMER, Hyundai, INFINITI, Isuzu, Jaguar, Jeep, Kia, Lamborghini, Land Rover, Lexus, Lincoln, Lotus, Maserati, Maybach, Mazda, McLaren, Mercedes-Benz, Mercury, MINI, Mitsubishi, Nissan, Oldsmobile, Panoz, Plymouth, Pontiac, Porsche, Ram, Rolls-Royce, Saab, Saturn, Scion, smart, Subaru, Suzuki, Tesla, Toyota, Volkswagen, Volvo.

List of updates

Each update involve re-scraping all makes, models, years and trim, the job takes about 50 hours at speed of 3 seconds per page.

TheCarConnection was originally 1997-present. As March 2018 they added specifications for 1996 models and also 1990-1995 models without specifications (only model names and price). I do not know if in the future, they will add specifications for pre-1996 cars too.

1136 models, 7224 model years, of which 6608 with specs, ? with trims, 46140 trims, as December 2017
1191 models, 8390 model years, of which 8074 with specs, 6644 with trims, 46804 trims, as 12 March 2018, published 18 March.
1210 models, 8651 model years, of which 8313 with specs (? full specs), 56363 trims (? full specs) as 20 September 2018.
1215 models, 8694 model years, of which 8313 with specs (? full specs), 56369 trims (? full specs) as 26 December 2018 (the source website did not added more specs in 3 months?)
1225 models, 8762 model years, of which 8439 with specs (7008 full specs), 57181 trims (49381 full specs) as 1 Feb 2019.
1229 models, 8790 model years, of which 8454 with specs (7023 full specs), 57312 trims (49512 full specs) as 28 March 2019.
1235 models, 8877 model years, of which 8547 with specs (7116 full specs), 58006 trims (50209 full specs) as 4 June 2019.

In mid-2019 TheCarConnection deleted pages of all model nameplates  discontinued before 2015. We can still see specs of 1990 Dodge Grand Caravan https://www.thecarconnection.com/overview/dodge_grand-caravan_1990 because a new model with same name is still in production today, but we cannot see anymore specs of Dodge Caravan (non-Grand) because this nameplate was discontinued in 2007! Strange decision to delete data for discontinued nameplates! Wasn’t TheCarConnection supposed to contain ALL cars that have been sold in United States since 1990 to present?

My idea was to scrap all cars and add 2019-2020 models from recent scrap over the 1990-2018 models from June scrap… I ran scraper again in September and early December without finding any significant number of cars added. I noticed that number of cars changed significantly in December so I ran scraper again on 18 December, to find a lot more 2020 models. But number of 2018 and 2019 models decreased, it means that TheCarConnection is not only updating with new cars but also doing changes in old cars, deleting / merging 2 similar trims into one, so how do I should combine files?

I decided at December 2019 update to provide separate files for June and December updates, leaving customers to combine. Depending by customers feedback, I will decide how to combine, if should provide combined files from my side.

521 models, 5629 model years, of which 5449 with specs, 44507 trims, as 16 Sep 2019
525 models, 5696 model years, of which 5460 with specs, 44558 trims, as 07 Dec 2019
554 models, 5785 model years, of which 5661 with specs, 46108 trims, as 15 Dec 2019
538 models, 5786 model years, of which 5660 with specs, 46107 trims, as 24 Dec 2019


Viewing all articles
Browse latest Browse all 126

Trending Articles