Compare large data

I'm expert in data processing with HUNDREDS of completed projects that's why I'm sure you'll be impressed with my work. The main question is how big is your file (in gigabutes) and how much memory do you have. Thanks. Roman

Hello I have an experience of 5 year in Linux platform and Mysql . I will setup a bash script to compare large data. PROFILE : Am a Redhat certified Engineer ( Cert ID : 120-202-320 )

The fastest way - load all data in memory from mysql and do compare. So you need a lot of ram. May be possible split into parts if the text file sorted and mysql table have index on sorted (in text file) field. I can create such script in python.

Hello To make this works the fastest I would suggest developing a Java application which would run locally at the server with the database. Please tell me more about the requirements. Best regards, Denis Poduzov

Hello ! Can you please provide me with a sample text file and db structure/script ? What version of PHP and MySQL you have installed ? I am confident that I can 100% complete this job for you full satisfaction. Regards, Sheroz

Hello! Would you be able to provide me with sample txt and mysql table schema? Basically i need some more details regarding the data structure to deliver most efficient solution. Any info you that you can give me will help. We could discuss the details via chat anytime. Please see my reviews for some references. Thank you.

Hello. More 20 years programming experience. I need more details to set real time and price - fastest way will be small program on C, otherwise, python or perl script. Regards. -----------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Plz send me a example data

A proposal has not yet been provided

I have been using Linux for over 10 years. If you want to do a simple text comparison, then the fastest way would be to dump the database table to a file, and use a Linux file compare utility. I can write a script to do this.

Hi i am a software engineer, i can help you doing that. since i am working o web development on linux environment.

Hello, I am a hard working person and i will get this job done as soon as possible. Thank you! Ben

will create a script using bash and sql, inbox me if interested

Hello there, my day job requires me to conduct similar projects as yours where I need to compare data from various sources. Recently I processed 30GB text file using Java with 2 mins runtime, parsing the text file into format readable by the target system. Approach There are 2 ways to approach this issue. 1. Download the data from MySQL database to a text file in your Linux system, and then run comparison using a Unix script between the two text files. 2. Upload the text file to the MySQL database and run the comparison in MySQL database using outer joins. Next Step Please feel free to contact me to discuss further on your file size and I can advise the best way to run the comparison. You can also let me know what constraint you have for example you need the comparison to run in X mins etc.

Hi, I have 15 years of experience using and administering Linux systems. Being an experienced programmer as well, I feel confident I can accomplish your project.

I worked as an electronic document interchange developer, and the team parsed documents and inserted them into the Web apps database.