Member Log In

Not a Member Yet?

It only takes a minute to start enjoying the benefits of AVForums membership, and it's free!

Foxsat-HDR FTP and telnet working

Post Reply
Old 17-01-2011, 7:27 PM   #121
Member
Join Date: Apr 2010
Thanks: Gave 64, Got 912
Posts: 930
Quote:
Originally Posted by ian_m42 View Post
Any chances of getting Samba running, so we can browse from Windows machines ?
The addition of extra services is limited by the physical flash ROM size. Only 1024Kb is allocated to the Linux busybox OS. Of this, 940Kb is currently used. I doubt if you can squeeze Samba binaries into 84Kb.
  Quote
Advert
Log in or sign up to remove
Old 17-01-2011, 7:28 PM   #122
Senior Member
Quaddy's Avatar
Join Date: Mar 2008
Thanks: Gave 232, Got 231
Posts: 1,690
bloated samba, NFS please
  Quote
Old 17-01-2011, 8:16 PM   #123
New Member
Join Date: Jan 2011
Thanks: Gave 1, Got 0
Posts: 3
Quote:
Originally Posted by raydon View Post
The addition of extra services is limited by the physical flash ROM size. Only 1024Kb is allocated to the Linux busybox OS. Of this, 940Kb is currently used. I doubt if you can squeeze Samba binaries into 84Kb.
Actually the flash rom size isn't a problem. There's no reason why any extra binaries can't be stored on the HDD only a link from the startup stuff needs to be in rom, and you don't even need that if you are happy to start extra services manually.

The limiting factors on the box are its RAM memory, CPU load and (depending on what you want to do) disk I/O activity

CPU load doesn't seem to be too much of an issue in normal use, even with 2 recordings going and watching a 3rd, /proc/loadavg still reports less than 0.5 (with 1 being fully loaded)

The RAM memory situation as reported by the command 'free' on my machine shows (in kilobytes)

total mem: 125536, used: 122956, free: 2580, buffers: 57808

at first sight that looks like very little free memory, however the 'buffers' figure can be thought of as free in that Linux flexibly uses most of whatever free memory there as buffer space.

However, if you left no free memory at all then Linux would have no buffer space... not good for performance.

The Humax does not make use of swap space, so the physical RAM is a hard limit.

I haven't done any assessment of disk i/o activity yet as the Humax lacks the tools that a full Linux install normally has. It does provide the raw data via /proc/diskstats but that file gives a snapshot figure of disk reads and writes, so to get a picture of i/o activity you need to collect that data at timed intervals. Something Linux admin tools normally take care of for you.

Last edited by tgabber; 18-01-2011 at 9:58 AM. Reason: vital typo - units on 'free' are kilobytes not bytes!
  Quote
Old 18-01-2011, 8:02 AM   #124
Member
Join Date: May 2008
Thanks: Gave 1, Got 20
Posts: 574
Quote:
Originally Posted by caldirun View Post
I am having the same problem, I created a folder in the Video folder and loaded a program into it, the folder or the program does not show on the Media list.
Does deleting, via FTP, the three files for a recording cause any problems ?
Ta
JL
  Quote
Old 18-01-2011, 10:09 AM   #125
Member
Join Date: Feb 2008
Thanks: Gave 0, Got 0
Posts: 51
Quote:
Originally Posted by jlearmonth View Post
Does deleting, via FTP, the three files for a recording cause any problems ?
Ta
JL
I tried this and it did not cause any problems.
  Quote
Old 18-01-2011, 11:46 AM   #126
Member
Join Date: Jul 2008
Thanks: Gave 8, Got 10
Posts: 138
Quote:
Originally Posted by raydon View Post
The addition of extra services is limited by the physical flash ROM size. Only 1024Kb is allocated to the Linux busybox OS. Of this, 940Kb is currently used. I doubt if you can squeeze Samba binaries into 84Kb.
OK then, how about a web server running like TiVo's have had for years. I set all my TiVo recordings via a web browser (usually from work ) and don't give me all the CPU resource issue the TiVo series 1 in UK is a 54MHz CPU with 16MB of RAM....

Here is a demo page of what the browser sees.
http://sites.google.com/site/thomson...attredirects=0

Wikipedia entry.
Tivoweb - Wikipedia, the free encyclopedia
  Quote
Old 18-01-2011, 3:03 PM   #127
New Member
Join Date: Jan 2011
Location: London
Thanks: Gave 1, Got 0
Posts: 4
Quote:
Originally Posted by ian_m42 View Post
OK then, how about a web server running like TiVo's have had for years. I set all my TiVo recordings via a web browser (usually from work ) and don't give me all the CPU resource issue the TiVo series 1 in UK is a 54MHz CPU with 16MB of RAM....
Been lurking on this thread (as I suspect many more people are - nice work Mogie) but yeah, a web interface would make a lot of sense. In particular, I'd love to be able to review and revise schedules via a web interface.

TiVo have a lot of people available to write this stuff: I expect running something like perl or python would be a lot of development work and a drain on CPU and RAM resources, so I thought I'd float the idea of putting a much simpler web server on there and put all the smarts in javascript on the client (eg webserver can send a page that contains the schedule file, javascript on the client does all the data manipulation and sends back an entire new schedule file). It wouldn't be perfect, or robust for multiple simultaneous users, but it might be easier to implement in the first place compared to putting a full copy of Apache and a scripting language onto the Humax and maintaining scripts etc - this way most "new features" would be provided by writing more javascript pages that the webserver serves as static content...

Is there documentation anywhere about the HDF file format and how you pack and unpack it ? Are the tools available from the HUMAX open source page or somewhere else ?
  Quote
Old 18-01-2011, 3:17 PM   #128
Limited Member
Join Date: Jan 2011
Thanks: Gave 2, Got 1
Posts: 19
Quote:
Originally Posted by meercat View Post
Is there documentation anywhere about the HDF file format and how you pack and unpack it ? Are the tools available from the HUMAX open source page or somewhere else ?
That's what I'm hoping for!

Dave.
  Quote
Old 18-01-2011, 4:18 PM   #129
Member
Join Date: May 2008
Thanks: Gave 1, Got 20
Posts: 574
Quote:
Originally Posted by meercat View Post
I'd love to be able to review and revise schedules via a web interface.
Yes it would be nice.
However reviewing and revising the schedules is a far more complex process than just ftping files to/from the box.
You would need full knowledge of how the schedules work.
As far as I know Humax don't release this info so people would be guessing.
And guessing is dodgy !
I may be wrong ( often am ).
JL
  Quote
Old 18-01-2011, 4:32 PM   #130
Member
Join Date: Jul 2008
Thanks: Gave 8, Got 10
Posts: 138
Quote:
Originally Posted by meercat View Post
......
TiVo have a lot of people available to write this stuff:
........
TiVo web is nothing to do with TiVo Corporation, once network access to TiVo was made possible (serial line in about 2000, ethernet 2002) someone wrote a web server in TCL.

Go look here for archive of the now defunct lightn.org, which was the main TiVoWeb delevelopment site. Started in Dec 2000, which is only a month after I got my TiVo.
Internet Archive Wayback Machine

I didn't get TiVoWeb until 2005 and my TiVo is still running today. Wonder if the Humax will be running in 10 years time .
  Quote
Old 18-01-2011, 4:32 PM   #131
New Member
Join Date: Jan 2011
Location: London
Thanks: Gave 1, Got 0
Posts: 4
Quote:
Originally Posted by jlearmonth View Post
Yes it would be nice.
However reviewing and revising the schedules is a far more complex process than just ftping files to/from the box.
You would need full knowledge of how the schedules work.
As far as I know Humax don't release this info so people would be guessing.
And guessing is dodgy !
True, but it depends how much of a hacker you are

I've reverse engineered a few things over the years (and I have a friend who sort of specialises in it) but yes, it's usually a case of trial and error, and sometimes it turns out to be simple, other times not so.

If I get some spare cycles (I haven't even tried this FTP/telnet access yet) then I'll poke around a few files and see if I can spot what might be where, but I expect there are other forums for such discussions.
  Quote
Old 18-01-2011, 8:59 PM   #132
Member
Join Date: Mar 2007
Thanks: Gave 56, Got 15
Posts: 332
Quote:
Originally Posted by raydon View Post
You've pretty much hit the nail on the head tagabber. This problem, and a fix (for Linux users anyway) has already been posted on DS.
Thread is here FTP upload to Humax - Freesat+ - Digital Spy Forums
Raydon, is it possible to adapt the Edit HMT option on AV2HDR so thick users can enter the path to the particular folder in the Video folder where they are about to send the 3 files via FTP when converted? I have seen the fix and it means nothing to me, I only use Linux to get me out of the mess Windows lands me in! or to clone my HDD.
  Quote
Old 19-01-2011, 5:30 AM   #133
Member
Join Date: May 2008
Thanks: Gave 1, Got 20
Posts: 574
Anyone know if it's possible to get the FOXSAT out of standby from the network ?
I have tried sending it WOL (Wake On Land) magic packets but no success.
Perhaps the network hardware needs special config to recognise the WOL.
I guess the hardware is some standard interface chip.

And how to send it to standby from a telnet session ?

JL
  Quote
Old 19-01-2011, 6:20 AM   #134
Senior Member
Join Date: Jan 2011
Location: Eauze 32800
Thanks: Gave 134, Got 364
Posts: 2,396
Quote:
Originally Posted by jlearmonth View Post
Anyone know if it's possible to get the FOXSAT out of standby from the network ?
I have tried sending it WOL (Wake On Land) magic packets but no success.
Perhaps the network hardware needs special config to recognise the WOL.
I guess the hardware is some standard interface chip.

And how to send it to standby from a telnet session ?

JL
Yes - It's not. The HDR power saving mode removes power from the Ethernet port in standby (possibly in order to comply with the EEC < 1 watt directive)
  Quote
Old 19-01-2011, 11:17 AM   #135
New Member
Join Date: Jan 2011
Location: London
Thanks: Gave 1, Got 0
Posts: 4
Quote:
Originally Posted by ian_m42 View Post
TiVo web is nothing to do with TiVo Corporation, once network access to TiVo was made possible (serial line in about 2000, ethernet 2002) someone wrote a web server in TCL.

Go look here for archive of the now defunct lightn.org, which was the main TiVoWeb delevelopment site. Started in Dec 2000, which is only a month after I got my TiVo.
Internet Archive Wayback Machine

I didn't get TiVoWeb until 2005 and my TiVo is still running today. Wonder if the Humax will be running in 10 years time .
Ah, ok.. I didn't realise the history behind it, sorry, but it still implies a significant body of work done over some time (cf mythtv), whereas I was wondering if a quick web server of the existing files could be knocked up while we wait for the hordes of software developers to descent on the Humax
  Quote
Old 19-01-2011, 11:55 AM   #136
Senior Member
GaseousClay's Avatar
Join Date: Jan 2011
Location: Worcester
Thanks: Gave 960, Got 857
Posts: 2,500
Quote:
Originally Posted by REPASSAC View Post
Yes - It's not. The HDR power saving mode removes power from the Ethernet port in standby (possibly in order to comply with the EEC < 1 watt directive)
Would it work if Power saving was disabled?
  Quote
Old 19-01-2011, 12:41 PM   #137
Senior Member
Join Date: Jan 2011
Location: Eauze 32800
Thanks: Gave 134, Got 364
Posts: 2,396
Quote:
Originally Posted by GaseousClay View Post
Would it work if Power saving was disabled?
I would not think so - the manual only mentions the LNB and scart loop-through and the time display. It's easy to try, you can see if the green light next to the HDR's port is lit or not.
However I don't think Humax has included the WOL function - in a DS thread on making remote recordings Bob_Cat implied there were two ways of doing this :
1. WOL and the problem was here was the port was not powered in standby or
2. Via the box waking up at intervals and checking the web. This has the advantage that you don't need port forwarding to be set-up on the clients router.
  Quote
Old 19-01-2011, 1:00 PM   #138
Member
Join Date: Apr 2010
Thanks: Gave 64, Got 912
Posts: 930
Quote:
Originally Posted by meercat View Post
Been lurking on this thread (as I suspect many more people are - nice work Mogie) but yeah, a web interface would make a lot of sense. In particular, I'd love to be able to review and revise schedules via a web interface.

TiVo have a lot of people available to write this stuff: I expect running something like perl or python would be a lot of development work and a drain on CPU and RAM resources, so I thought I'd float the idea of putting a much simpler web server on there and put all the smarts in javascript on the client (eg webserver can send a page that contains the schedule file, javascript on the client does all the data manipulation and sends back an entire new schedule file). It wouldn't be perfect, or robust for multiple simultaneous users, but it might be easier to implement in the first place compared to putting a full copy of Apache and a scripting language onto the Humax and maintaining scripts etc - this way most "new features" would be provided by writing more javascript pages that the webserver serves as static content...

Is there documentation anywhere about the HDF file format and how you pack and unpack it ? Are the tools available from the HUMAX open source page or somewhere else ?
Seekers of the knowledge might want to start HERE
  Quote
Old 19-01-2011, 1:03 PM   #139
Member
Join Date: Apr 2010
Thanks: Gave 64, Got 912
Posts: 930
Quote:
Originally Posted by caldirun View Post
Raydon, is it possible to adapt the Edit HMT option on AV2HDR so thick users can enter the path to the particular folder in the Video folder where they are about to send the 3 files via FTP when converted? I have seen the fix and it means nothing to me, I only use Linux to get me out of the mess Windows lands me in! or to clone my HDD.
I intend to release an update to AV2HDR to address this issue. Watch this space.
  Quote
Thanks from:
REPASSAC (19-01-2011)
Old 19-01-2011, 2:50 PM   #140
Limited Member
Join Date: Jan 2011
Thanks: Gave 2, Got 1
Posts: 19
Quote:
Originally Posted by raydon View Post
Seekers of the knowledge might want to start HERE
From that page:

---
hdpvr.hmx consists of 3 parts. The interesting one is the Flash_70000.bin (contains root_fs – root file system /). Once extracted from hdpvr.hmx, you’re able to copy the Flash_700000.bin to elsewhere for further work.
---

Which doesn't tell me how to extract the 3 parts of the .hmx file.

Dave.
  Quote
Old 19-01-2011, 5:44 PM   #141
Member
Join Date: Apr 2010
Thanks: Gave 64, Got 912
Posts: 930
Quote:
Originally Posted by davestubbs View Post
From that page:

---
hdpvr.hmx consists of 3 parts. The interesting one is the Flash_70000.bin (contains root_fs – root file system /). Once extracted from hdpvr.hmx, you’re able to copy the Flash_700000.bin to elsewhere for further work.
---

Which doesn't tell me how to extract the 3 parts of the .hmx file.

Dave.
From the same page:
---
One word on the legal aspect: Decrypting and providing a modified version of a vendor’s software isn’t allowed by law. So you will not find a link to the decryption tool or to the patched firmware at all. I’ll explain the how-to, and provide some basic stuff, and finally the root file system with some add-ons. If you’re looking for decrypting / encrypting iCord’s firmware you may find something in Google by searching for “colibri” in relation to iCord.
---
  Quote
Old 19-01-2011, 7:18 PM   #142
Member
Join Date: Mar 2007
Thanks: Gave 56, Got 15
Posts: 332
Quote:
Originally Posted by raydon View Post
I intend to release an update to AV2HDR to address this issue. Watch this space.
Many thanks from all, in anticipation.
  Quote
Thanks from:
staceydsf (19-01-2011)
Old 20-01-2011, 8:01 AM   #143
Member
Join Date: May 2008
Thanks: Gave 1, Got 20
Posts: 574
Quote:
Originally Posted by avie9 View Post
I tried this and it did not cause any problems.
I deleted two large movies (6 files) using ftp.
Unfortunately I didn't check the percent usage reported by the FOXSAT media list before doing this.
However I got the "impression" that the media list had not picked up the release space.
I should have checked first !
Does it pick up the released space ??
JL
  Quote
Old 20-01-2011, 2:12 PM   #144
Member
Join Date: Jul 2008
Thanks: Gave 8, Got 10
Posts: 138
Quote:
Originally Posted by meercat View Post
Ah, ok.. I didn't realise the history behind it, sorry, but it still implies a significant body of work done over some time (cf mythtv), whereas I was wondering if a quick web server of the existing files could be knocked up while we wait for the hordes of software developers to descent on the Humax
TiVoWeb is written in TCL see
Tcl - Wikipedia, the free encyclopedia
and is as such not really a webserver as TCL generates the HTML on the fly. You add futher modules (in TCL) to the modules directory and they then appear as a menu option on the start page.

Looking at the TCL scripts they are along the lines of
Code:
ForeachMfsFileTrans fsid name type $nowshowingdir "" 15 {
set rec [db $db openid $fsid]
if {$nstype == 6} { print_nowshowingrow $chan $rec $nstype $rcount
incr rcount
} else { print_nowshowingrow $chan $rec $nstype }
This prints out to a network port the contents of the "Now Showing" (ie recordings) list. TiVo stores everything, video data, epg data, etc in a giant database called MFS (media file system).
  Quote
Old 20-01-2011, 4:39 PM   #145
Member
Join Date: Jun 2006
Thanks: Gave 2, Got 2
Posts: 37
Nice (V. NICE) piece of work. You beat me to it!! I had lined this up to be a "little" project to keep away the winter blues, and had started on it last week and had found the iCord forum and "Cats" blog. I've picked out the "raw" squashfs files you've changed by comparing the Humax 10013 firmware with your release, using tools found via the iCord forum (there seem to be an awful lot of versions of unsquashfs) and see that you've added tinyftp and utelnetd into the bin directory, and corresponding entries into the etc/init.d directory. Plus a number of other files such as fstab. passwd, shadow and others are showing build dates of 28Nov09, rather than more recent dates. I'm wondering why that should be? A project started and then set aside maybe? My hope had been smb or nfs connectivity, I suppose to avoid having to ftp in. With the fuller connectivity I might have automated some type of backup of the foxsat recordings onto my NAS drives. Plus there was always the hope of being able to use the foxsat as a media player for files already on the NAS, as I do now with a popcorn-hour and an ASUS O!play. Far too many boxes for my family to cope with. I suppose the main driving force tho was curiosity and the challenge ;-). Can you shed some more light on your work and where it's going. Maybe off-forum where appropriate.

Last edited by RobinE; 20-01-2011 at 7:23 PM. Reason: typos
  Quote
Old 20-01-2011, 6:50 PM   #146
Member
Join Date: Mar 2007
Thanks: Gave 56, Got 15
Posts: 332
Quote:
Originally Posted by caldirun View Post
I am having the same problem, I created a folder in the Video folder and loaded a program into it, the folder or the program does not show on the Media list.
I am having problems with the HDR not accepting my password at times, it locked me out yesterday and again today (yesterday the ip changed from .3 ending to .2) The FTP setup seems a bit buggy.
Good news, the HDR will accept .jpg, .mp3, and folders containing such files via FTP with no problems, just have to hope Raydon gets us the Video folder address bug sorted and it will save a lot of USB plugging and unplugging.
  Quote
Old 20-01-2011, 10:57 PM   #147
New Member
Join Date: Sep 2007
Thanks: Gave 15, Got 1
Posts: 25
I have an external hard drive plugged into the rear USB.
FTP AV2HDR files to the hard dive works without problem, the media list shows the program, and it plays OK
  Quote
Old 21-01-2011, 9:45 AM   #148
New Member
Join Date: Oct 2010
Thanks: Gave 2, Got 4
Posts: 15
UPNP Server

Morning Guys

Good News - I successfully installed a UPNP server onto the HDR yesterday - I then was able to stream directly to a UPNP client over the network - I used XBMC as my client.

The operation could be smoothed out a lot and currently it requires you to manually start the upnp server, the downside is the media server seems to be a 30 day trial.

Here is what I did:-

Download Twonkymedia server from here
  • [url=http://www.twonkyforum.com/unsupported/4.4.18/twonkymedia-mipseb-uclibc-0.9.28-4.4.18.zip[/url] but specifically this version - Linux MIPS big endian uclibc 0.9.28
  • Unzip the file
  • Copy it over to the HDR - any method you like (USB stick, FTP etc etc) - I placed mine here /media/Music/twonky, Make sure you put it on the HDD or leave it on a USB drive as anything put onto the root filesystem will be erased on reboot.
  • Telnet into the box - if you used windows to copy the files over you may have lost the file permissions so change to the directory where you put the files using 'cd' and then run 'chmod -R +x *'
  • Then run './twonkymedia'
  • The server should now be started - We now need to configure the server
  • Back on your pc - put your HDR IP address followed by :9000 into a browser - mine is http://192.168.1.2:9000
  • Click 'Configure Server'
  • Fill in the basic details on the front page choosing a name for your upnp server
  • Click Save Changes - I think you then click 'Maintenance' then 'Restart'
  • Once it has restarted - go to 'Sharing' and configure it to point at /media/Videos/ but select to to scan for all types of files - Save the settings and complete the step above to restart the server
  • Go Back to Sharing and click the 'Rescan Media' button - this will then rescan the files in the /media/Video folder
  • Once more for good luck - complete the step above again to restart the twonky server

Your now ready to connect up using your fav UPNP client - I tested it with XBMC

My directions maybe a little patchy as I planned to leave logmein running on my PC at home today so I can reference the actually setup while writing this post - unfortunately it has stopped running so I have had to do it from memory.

Hope you all manage to get it working and Good Luck.

Kudos and thanks go to Mogie - without his work i would not have been able to get this done. Well done buddy and I look forward to seeing more hacks for the HDR.

Lrmulli


Link edited - thanks to @twosheds

Last edited by lrmulli; 21-01-2011 at 4:15 PM.
  Quote
Thanks from:
coachdriver (22-01-2011), Quaddy (22-01-2011), swedish cook (21-01-2011), zoot149 (30-01-2012)
Old 21-01-2011, 11:28 AM   #149
Member
Join Date: May 2002
Location: Berkshire
Thanks: Gave 4, Got 3
Posts: 227
This is great news!!!

Well done guys you have taken this to the next level.

Is it just me or does it feel like the flood gates are about to open for new ventures with these boxes!

I have an old NAS that runs busybox linux on a very small arm cpu and that is capable of running all sorts (lighttpd, transmission, php) so I think the opportunity is there to have relatively sophisiticated interfaces.

It will however all be limited to just messing with the files unless someone is able to reverse engineer the freesat bits and pieces.

It might be a good idea if someone can setup a project wiki for this so that people can work independently without too much duplication of effort and benefit from each other. Also a sensible wish list of add ons.

Personally I would like to see superior management of recording scheduling in non freesat mode.

I think I am going to see if I can get lighttpd running as this would enable many other things.

Tim
  Quote
Old 21-01-2011, 1:42 PM   #150
Limited Member
Join Date: May 2008
Thanks: Gave 28, Got 4
Posts: 39
upnp server

Irmulli
I've installed Twonkymedia (using Filezilla) following your instructions but when I run './twonkymedia' I receive the following message

./twonkymedia: ./twonkymedia: 1: Syntax error: word unexpected (expecting ")")

I tried the command '/mnt/hd4/Music/twonky/twonkymedia.sh' and received the following messages

/mnt/hd4/Music/twonky/twonkymedia.sh: /mnt/hd4/Music/twonky/twonkymedia.sh: 29: dirname: not found

Twonky server
-------------
Syntax:
/mnt/hd4/Music/twonky/twonkymedia.sh {start|stop|restart|reload|status}



I then tried '/mnt/hd4/Music/twonky/twonkymedia.sh start' and received the following messages

/mnt/hd4/Music/twonky/twonkymedia.sh: /mnt/hd4/Music/twonky/twonkymedia.sh: 29: dirname: not found
Twonky servers not found.



Is there something else I need to do in addition to your instructions to get the server to run ?

Thanks
  Quote
Post Reply



Thread information and display options
Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts
BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are Off
Refbacks are Off