How to import Live Data from URL address which is in .txt format


(Nessarchitecture) #1

Hi all,

I’ve been trying to import live data from the National Buoy Center and having difficulties as their url is .txt not .xml. Having looked at previous threads I discovered a read file for URL addresses here: http://www.grasshopper3d.com/forum/topics/read-webpage however, though this imports the data it does not update after applying a timer.

Does anyone know how to import and update data live from .txt URL addresses? Having also looked at GHowl it appears to favour XML format data? Could there be a way round this?

Live Data Required (Updated roughly every 6 minutes)
http://www.ndbc.noaa.gov/data/realtime2/KYWF1.txt

Any info you guys could provide would be greatly appreciated.

URL Reader.ghx (58.9 KB)


.CSV with columns to points
#2

Right-click and “Edit Source…” on the Web component, set bool cache = false;?

code


(Nessarchitecture) #3

Ah that’s fixed it, thank you very much! Diving into the C# script is not something I have encountered before.

Each time stamped data entry appears as one item in the list. Would you know how to break these down into a series of lists? mm as one list dd as another etc.? At present I can’t see a way of identifying individual figures. Essentially all I am looking to do is select the current water temperature for input into another script.

Again, many thanks for your help, it is very much appreciated!


#4

It’s called “parsing”. Plenty of examples if you search the GH forums. The best way to ask that question is to internalize the data and present a simple example, like this, which contains only the first 100 lines from your example, instead of 10,869 lines in your real data:


parse_data_2018Feb1a.gh (14.8 KB)


(Nessarchitecture) #5

Perfect, I’ve got it through searching Parsing. Many thanks again!


#6

I found more on the old forum than the new one.

The last time I tried this, it was harder than it should be because GH doesn’t implement “whitespace” as a delimiter, so handling multiple spaces between columns was a pain. Maybe you can help others by posting what you did to parse this data? Cheers.


(Nessarchitecture) #7

I’m sure this is a long-winded way of doing it but it does the job.

I just text split with a space then split each tree into further trees. This allowed me to simply select the item (in this case, most recent water temperature) as a singular piece of data.Data Selecting.gh (6.7 KB)


#8

I see. Well, getting the job done is good. It can be done much better though… Just FYI, it’s usually a bad idea to pass data through a text panel, for various reasons.


(Nessarchitecture) #9

I’ll take a proper look at parsing once I’ve got it all up and running as I’m sure this is just a quick fix… Oh, I’ll make sure to rectify that from on.

Many thanks again!


#10

Check this out:


parse_data_2018Feb1b.gh (18.4 KB)


(Nessarchitecture) #11

Ah nice, that does exactly what I was originally after!

I’ve never used flip matrix before - works a treat!

That’s me sorted, thanks!