1 Topic by charlesroper

  • charlesroper
  • charlesroper
  • Digital Development Manager
  • Offline
  • From: Field Studies Council
  • Registered: 26-03-2006
  • Posts: 906

Topic: Upload limits

I think I'm running into upload limits on CSV files I'm importing into my warehouse. The file uploads, but the UI dumps me back to the 'Record of import' screen but with nothing on it. I've tried with a small file and that works as expected, so I think this must be file-size related.

Is there a way of manually uploading a CSV and importing it directly from the server? Or will I update my php.ini? Any guidance appreciated. The CSV is 75MB overall and split down to 50k row chunks is about 12MB.

Charles Roper
Digital Development Manager | Field Studies Council
http://www.field-studies-council.org | https://twitter.com/charlesroper | https://twitter.com/fsc_digital

charlesroper's Website

2 Reply by Jim Bacon

  • Jim Bacon
  • Veteran
  • Offline
  • From: BRC
  • Registered: 03-11-2008
  • Posts: 980

Re: Upload limits

Hi Charles

I don't know a way to work round the upload process. I have several times adjusted php.ini to increase the upload limits on the warehouses that I look after. You may need to increase both post_max_size and upload_max_filesize.

However, we also commonly see timeouts on processing big uploads. They can take minutes rather than seconds to complete so increase max_execution_time. (As a side note to IIS users with Fast CGI enabled, this also contains timeouts that may need adjusting)

Jim Bacon

3 Reply by charlesroper

  • charlesroper
  • charlesroper
  • Digital Development Manager
  • Offline
  • From: Field Studies Council
  • Registered: 26-03-2006
  • Posts: 906

Re: Upload limits

Thanks Jim, you confirmed my suspicions. I'm using Ubuntu Server 12.04 and here's what I ended up adjusting:

/etc/php5/apache2/php.ini

memory_limit = 128M
upload_max_filesize = 15M
post_max_size = 20M
max_execution_time = 120

This post was helpful: http://www.cyberciti.biz/faq/linux-unix … oad-limit/

I also had to modify the Indicia configuration:

application/config/indicia.php

$config['maxUploadSize'] = '15M';
Charles Roper
Digital Development Manager | Field Studies Council
http://www.field-studies-council.org | https://twitter.com/charlesroper | https://twitter.com/fsc_digital

charlesroper's Website

4 Reply by Jim Bacon

  • Jim Bacon
  • Veteran
  • Offline
  • From: BRC
  • Registered: 03-11-2008
  • Posts: 980

Re: Upload limits

Thanks for the update, Charles.

Another tip for users of IIS 6 is that you have to stop and start the web server to apply changes to php.ini. Checking the output of phpinfo() has really helped me sometimes.

Jim Bacon.