|
|
| Line 540: |
Line 540: |
| ### '''Geopaparazzi''': [https://play.google.com/store/apps/details?id=eu.hydrologis.geopaparazzi&hl=en android] only | | ### '''Geopaparazzi''': [https://play.google.com/store/apps/details?id=eu.hydrologis.geopaparazzi&hl=en android] only |
|
| |
|
| == OpenRefine Update == | | == Updates == |
| From Chris Evelyn
| |
| | |
| Allocating more memory to OpenRefine
| |
| | |
| 1. The issue: I wanted to make a database with ~350,000 rows of data
| |
| from VertNet but GoogleRefine 2.5 and OpenRefine 2.6 were bogging down
| |
| during the 'Create' step
| |
| | |
| 2. Solution: allow OpenRefine to allocate more memory to its processes.
| |
| The default setting is 1024Mb (~1Gig).
| |
| | |
| 3. What the problem looked like: during the 'Create' step the "Heap
| |
| usage" would max out and show something like "1000/1000Mb used". In the
| |
| newer OpenRefine versions this message pops up with a red highlight when
| |
| it's maxed out. Once this happens the time to finish just grows and
| |
| grows and nothing good happens.
| |
| | |
| 4. Fixing the problem: there are three steps to fixing this problem
| |
| | |
| A) be sure that the Java development kit is installed.
| |
| Get the kit here:
| |
| [http://www.oracle.com/technetwork/java/javase/downloads/jdk8-downloads-2133151.html http://www.oracle.com/technetwork/java/javase/downloads/jdk8-downloads-2133151.html]
| |
| Manage the path here so OpenRefine can find it:
| |
| [https://confluence.atlassian.com/doc/setting-the-java_home-variable-in-windows-8895.html https://confluence.atlassian.com/doc/setting-the-java_home-variable-in-windows-8895.html]
| |
| | |
| B) Allocate more memory. Be sure to check whether you are using the .bat
| |
| file or the .exe application to run Refine as this affects how you fix
| |
| the problem. You end up having to edit the .ini files, instructions for
| |
| both fixes here:
| |
| [http://www.oracle.com/technetwork/java/javase/downloads/jdk8-downloads-2133151.html http://www.oracle.com/technetwork/java/javase/downloads/jdk8-downloads-2133151.html]
| |
| | |
| The amount of memory needed will obviously vary depending on the job and
| |
| on what your computer can handle. For the 350,000 rows of VertNet data
| |
| (lots of columns!) I needed about 8 times the amount of default RAM
| |
| (8*1024= 8192). I have 16GB RAM so this was fine but definitely keep in
| |
| mind how much RAM you have an what else you are running at the time. I
| |
| don't know why the increments are in multiples of 1024 but some
| |
| knowledgeable person out there probably does.
| |
| | |
| C) The changes may work if you close all Refine sessions and start over.
| |
| If not then restart the computer.
| |