EBC Exercise 08a Cross-Compiling

This class is about developing software for embedded Linux. The eLinux site is a good source for embedded Linux in general. There are many ongoing embedded efforts going on many platforms. Poke around the site a while to get a feel for what's happening.

We are going to use the Ångström Distribution. It's available many platforms. Look around the site, you may recognize some of them.

Instructions for building Ångström are given here; however I'm going to present a Beagle-tuned version of those instructions on this page.

Step 1 - get Open Embedded metadata
First install  by running the following on your host computer. $ sudo apt-get install git-core Here is a nice git tutorial. Take a look at it if you want to understand the commands that follow.

Then run the following to load the meta data. $ export OETREE="${HOME}/oe" $ mkdir -p ${OETREE} && cd ${OETREE} $ git clone git://git.openembedded.org/openembedded.git openembedded $ cd openembedded $ git checkout origin/stable/2009 -b stable/2009 If  does not work, you can also try: ECE597 git notes
 * git://gitorious.org/angstrom/openembedded.git
 * git://gitorious.org/angstrom/openembedded.git

The first git transfers some 336,000 object and takes about 18 minutes with the network running at 600 some KiB/s. Keep an eye on it, mine stopped about 23% in and I had to restart it. The second git takes almost no time.

Now run the following to update the metadata: $ cd ${OETREE}/openembedded $ git pull You've created a directory called. Go explore around it to see what is there. Be sure to look in. These folders contain instructions on where to get and how to build various things. Look in. Here are instructions for building various Linux kernels. We'll be using. What's the highest version you can find?

Step 2 - Installing bitbake and friends
bitbake is the workhorse that knows where to get everything and how to compile it. The following will install bitbake and additional programs that bitbake needs. This may take 5 minutes. $ sudo apt-get install bitbake $ sudo apt-get install g++ $ sudo apt-get install help2man diffstat texi2html cvs texinfo subversion gawk $ sudo apt-get autoremove If you are running Ubuntu you will have to also do the following: $ cd /bin $ sudo mv sh sh.old $ sudo ln -s bash sh $ sudo sh -c "echo 0 > /proc/sys/vm/mmap_min_addr" Finally edit the file  using: $ sudo gedit /etc/sysctl.conf Add the following at the end and save. vm.mmap_min_addr = 0 Now you should be ready to run bitbake.
 * 1) This is for bitbake

The Psyco Python JIT compiler should help speed up compilation times at the expense of memory use. It only works on 32-bit systems. To install, use $ sudo apt-get install python-psyco

Step 3 - Setting up for the BeagleBoard
Now let's setup  for our needs: $ mkdir -p ${OETREE}/build/conf $ cp ${OETREE}/openembedded/contrib/angstrom/local.conf ${OETREE}/build/conf/ Open  in your favourite editor and add the following to the end of the file. MACHINE ?= "beagleboard" Also, look at this block of lines: PARALLEL_MAKE = "-j4" BB_NUMBER_THREADS = "4" Here you can tell it how many parallel threads to run. If you have several cores on your machine, make this number big. If you have only one core, you might be better performance setting it to 1. More details are here.
 * 1) Make use of SMP and fast disks
 * PARALLEL_MAKE sets the number "gcc" threads (same as make -j4 at compile time
 * BB_NUMBER_THREADS sets the number of bitbake threads, (one thread can be downloading, while another compiles)

To save you a lot of time, it is useful to disable locale generation for all but the one you need. Add this to local.conf GLIBC_GENERATE_LOCALES = "en_US.UTF-8 en_GB.UTF-8 de_DE.UTF-8 fr_FR.UTF-8 pt_BR.UTF-8 es_ES.UTF-8 kn_IN.UTF-8 ml_IN.UTF-8 ta_IN.UTF-8"

Step 4 - Start building
We need to create a small script to setup the environment

$ cd ${OETREE} $ wget -c http://www.angstrom-distribution.org/files/source-me.txt


 * Take a second to read the script, and notice that it configures a download directory, a build directory, and a staging directory. Can you explain why ${PATH} is modified in this script?

Now we are almost ready for compiling $ cd ${OETREE}/openembedded
 * 1) Go to the OpenEmbedded folder

$ git pull --rebase
 * 1) Make sure it's up to date

$ cd ${OETREE} $ source source-me.txt
 * 1) Set environment variables

$ bitbake nano
 * 1) Start building

This will take a while. bitbake is installing everything that is needed to compile the system. This includes cross compilers, assemblers, source, everything. I started at 10am and ended around 5:30pm. It was running on just one of the two cores on my laptop. How long did it take on your machine? I notice that an additional 600M of disk space is being used.

Step 5 - Building a complete image
Up to this point all we have done is load all the infrastructure needed and compiled the simple nano text editor. We don't even have the kernel yet. Do the following to build a basic console image. $ bitbake console-image This bitbake took 7 hours and 15 minutes. There are now some 7,700 directories with 67,000 files in the   directory. An additional 1.5G of disk space is in use.

How did I know to use console-image? I ran the following to find what images were out there: $ locate image | grep /oe/ This found every file with image in the name it that also had /oe/ in the path. From this I see that oe/openembedded/recipes/images has a bunch of files ending in -image. Take a look at console-image.bb and see what you can figure out.

Step 6 - Loading your SD card
The output of the bitbake command will ultimately be found under the. In there you can find at least two interesting files: console-image-beagleboard.tar.bz2 uImage-beagleboard.bin The console image represents a full and self-contained file system, *including* a kernel. The uImage-beagleboard.bin is a Linux kernel image suitable for loading by the U-boot bootloader.


 * Rename uImage-beagleboard.bin as uImage and load on your SD as before (ECE597 Getting your Beagle running (precompiled)).
 * Also load console-image-beagleboard.tar.bz2 on the 2nd partition like you did before. Did you notice it untar's very quickly?  Why?
 * Boot and explore. What's there?  What's missing?

Congratulations you've just build Linux from source. Try this: beagleboard login: root root@beagleboard:~# cd /sys/class root@beagleboard:/sys/class# ls -F bdi/         hwmon/        misc/         scsi_generic/ usb_device/ block/       i2c-adapter/  mmc_host/     scsi_host/    usb_endpoint/ bluetooth/   i2c-dev/      mtd/          sound/        usb_host/ bmi/         ieee80211/    net/          spi_master/   usbmon/ display/     input/        regulator/    spidev/       vc/ firmware/    leds/         rtc/          thermal/      vtconsole/ gpio/        mdio_bus/     scsi_device/  tty/ graphics/    mem/          scsi_disk/    ubi/ This is a list of low-level devices on the Beagle that you can access as files. Try: root@beagleboard:/sys/class# cd leds/ root@beagleboard:/sys/class/leds# ls -F beagleboard::usr0@ beagleboard::usr1@ root@beagleboard:/sys/class/leds# cd beagleboard\:\:usr0 root@beagleboard:/sys/devices/platform/leds-gpio/leds/beagleboard::usr0# cat trigger none nand-disk mmc0 mmc1 [heartbeat] This is a list of values you can assign to trigger. Notice LED0 is blinking on and off right now. Try: root@beagleboard:/sys/devices/platform/leds-gpio/leds/beagleboard::usr0# echo none > trigger root@beagleboard:/sys/devices/platform/leds-gpio/leds/beagleboard::usr0# echo 1 > brightness What happens? Play around. Here are instructions on reading the USER switch. Try it. Can you make the LEDs blink in response to the button being pressed?

Step 7 - Building a complete Beagle demo image
Now let's build the how demo we were running before. We'll do this via bitbake, but argument do we give it? Try looking in, do you see a recipe that might work? Hint: It has beagle in the name. Here's what I tried. $ time bitbake beagle????-image Replace ???? with the recipe name you found. I added the time command so I could see how long it takes to run. My run took some 7.5 hours.

If you're having trouble with Gimp and/or gnumeric, consult ECE597 OpenEmbedded Issues and Problem_Solving.

Step 7.5 Building a complete unstable Beagle demo image
I did not have as much luck getting Ångström working in the stable OE branch, but I was able to make dev work. You should see that there are two branches available to to choose from. $ git branch org.openembedded.dev
 * stable/2009

So switch to the .dev branch by saying

$ git checkout org.openembedded.dev $ git pull # may not be needed

The OE dev branch does not ship with its own version of bitbake, so you will need to obtain bitbake from another source. Compiling from the OE dev branch seems to require an up-to-date version of bitbake. Install this by running

$ cd ${OETREE} $ wget http://download.berlios.de/bitbake/bitbake-1.8.18.tar.gz $ tar -xvf bitbake-1.8.18.tar.gz This will download and unpack version 1.8.18 of bitbake. Currently, this version seems to work well with the OE dev branch. You must now edit the path that points to bitbake in the source-me.txt file so that it will point to the directory containing this version of bitbake. You should change the line containing

PATH=${OETREE}/openembedded/bitbake/bin:${ORG_PATH} to the following:

PATH=${OETREE}/bitbake-1.8.18/bin:${ORG_PATH} NOTE: If you have modified the  setting in   to contain only , your build may fail due to missing required locales. You should have this set to  for the build to be successful. If you local.conf file does not have a line containing, your build still should be successful as it will, by default, include all available locales, including those mentioned above. Can you figure out where this list of locals came from?

We must now wipe out our stable build directory, as the two branches are not compatible. (Feel free to make a backup if you feel inclined). $ rm -rf ${OETREE}/angstrom-dev/

Now you may follow the directions above by running $ time bitbake beagle????-image

This will take a VERY long time, as it must recompile everything that was done previously. On my E8400 it took 10.4 hours to run with all locales, and 9.3 hours with only the ones I needed. It also used 17gb of space.

Once it has finished take a look in $ ls ${OETREE}/angstrom-dev/deploy/glibc/images/beagleboard

You should recognize the files from when you previously installed Angstrom, if not re-read ECE597_Getting_your_Beagle_running_(precompiled)

The first boot of my beagle took a very long time...a few minutes (subsequent boots are faster), the beagle will hang on the below screen for a while, just let it go and it will continue. INIT: version 2.86 booting Error. Cannot create canvas. Abort.

I also saw a lot of these errors, again you can probably ignore them. (if you can figure out how to fix, post fix here) Cannot find fifo at /mnt/.splash/exquisite. To fix it just do: opkg remove exquisite It will some speed up boot (it will not hung for a few min after INIT: version 2.86 booting).

This class is about developing software for embedded Linux. The eLinux site is a good source for embedded Linux in general. There are many ongoing embedded efforts going on many platforms. Poke around the site a while to get a feel for what's happening.

We are going to use the Ångström Distribution. It's available many platforms. Look around the site, you may recognize some of them.

Instructions for building Ångström are given here; however I'm going to present a Beagle-tuned version of those instructions on this page.

Step 1 - get Open Embedded metadata
First install  by running the following on your host computer. $ sudo apt-get install git-core Here is a nice git tutorial. Take a look at it if you want to understand the commands that follow.

Then run the following to load the meta data. $ export OETREE="${HOME}/oe" $ mkdir -p ${OETREE} && cd ${OETREE} $ git clone git://git.openembedded.org/openembedded.git openembedded $ cd openembedded $ git checkout origin/stable/2009 -b stable/2009 If  does not work, you can also try: ECE597 git notes
 * git://gitorious.org/angstrom/openembedded.git
 * git://gitorious.org/angstrom/openembedded.git

The first git transfers some 336,000 object and takes about 18 minutes with the network running at 600 some KiB/s. Keep an eye on it, mine stopped about 23% in and I had to restart it. The second git takes almost no time.

Now run the following to update the metadata: $ cd ${OETREE}/openembedded $ git pull You've created a directory called. Go explore around it to see what is there. Be sure to look in. These folders contain instructions on where to get and how to build various things. Look in. Here are instructions for building various Linux kernels. We'll be using. What's the highest version you can find?

Step 2 - Installing bitbake and friends
bitbake is the workhorse that knows where to get everything and how to compile it. The following will install bitbake and additional programs that bitbake needs. This may take 5 minutes. $ sudo apt-get install bitbake $ sudo apt-get install g++ $ sudo apt-get install help2man diffstat texi2html cvs texinfo subversion gawk $ sudo apt-get autoremove If you are running Ubuntu you will have to also do the following: $ cd /bin $ sudo mv sh sh.old $ sudo ln -s bash sh $ sudo sh -c "echo 0 > /proc/sys/vm/mmap_min_addr" Finally edit the file  using: $ sudo gedit /etc/sysctl.conf Add the following at the end and save. vm.mmap_min_addr = 0 Now you should be ready to run bitbake.
 * 1) This is for bitbake

The Psyco Python JIT compiler should help speed up compilation times at the expense of memory use. It only works on 32-bit systems. To install, use $ sudo apt-get install python-psyco

Step 3 - Setting up for the BeagleBoard
Now let's setup  for our needs: $ mkdir -p ${OETREE}/build/conf $ cp ${OETREE}/openembedded/contrib/angstrom/local.conf ${OETREE}/build/conf/ Open  in your favourite editor and add the following to the end of the file. MACHINE ?= "beagleboard" Also, look at this block of lines: PARALLEL_MAKE = "-j4" BB_NUMBER_THREADS = "4" Here you can tell it how many parallel threads to run. If you have several cores on your machine, make this number big. If you have only one core, you might be better performance setting it to 1. More details are here.
 * 1) Make use of SMP and fast disks
 * PARALLEL_MAKE sets the number "gcc" threads (same as make -j4 at compile time
 * BB_NUMBER_THREADS sets the number of bitbake threads, (one thread can be downloading, while another compiles)

To save you a lot of time, it is useful to disable locale generation for all but the one you need. Add this to local.conf GLIBC_GENERATE_LOCALES = "en_US.UTF-8 en_GB.UTF-8 de_DE.UTF-8 fr_FR.UTF-8 pt_BR.UTF-8 es_ES.UTF-8 kn_IN.UTF-8 ml_IN.UTF-8 ta_IN.UTF-8"

Step 4 - Start building
We need to create a small script to setup the environment

$ cd ${OETREE} $ wget -c http://www.angstrom-distribution.org/files/source-me.txt


 * Take a second to read the script, and notice that it configures a download directory, a build directory, and a staging directory. Can you explain why ${PATH} is modified in this script?

Now we are almost ready for compiling $ cd ${OETREE}/openembedded
 * 1) Go to the OpenEmbedded folder

$ git pull --rebase
 * 1) Make sure it's up to date

$ cd ${OETREE} $ source source-me.txt
 * 1) Set environment variables

$ bitbake nano
 * 1) Start building

This will take a while. bitbake is installing everything that is needed to compile the system. This includes cross compilers, assemblers, source, everything. I started at 10am and ended around 5:30pm. It was running on just one of the two cores on my laptop. How long did it take on your machine? I notice that an additional 600M of disk space is being used.

Step 5 - Building a complete image
Up to this point all we have done is load all the infrastructure needed and compiled the simple nano text editor. We don't even have the kernel yet. Do the following to build a basic console image. $ bitbake console-image This bitbake took 7 hours and 15 minutes. There are now some 7,700 directories with 67,000 files in the   directory. An additional 1.5G of disk space is in use.

How did I know to use console-image? I ran the following to find what images were out there: $ locate image | grep /oe/ This found every file with image in the name it that also had /oe/ in the path. From this I see that oe/openembedded/recipes/images has a bunch of files ending in -image. Take a look at console-image.bb and see what you can figure out.

Step 6 - Loading your SD card
The output of the bitbake command will ultimately be found under the. In there you can find at least two interesting files: console-image-beagleboard.tar.bz2 uImage-beagleboard.bin The console image represents a full and self-contained file system, *including* a kernel. The uImage-beagleboard.bin is a Linux kernel image suitable for loading by the U-boot bootloader.


 * Rename uImage-beagleboard.bin as uImage and load on your SD as before (ECE597 Getting your Beagle running (precompiled)).
 * Also load console-image-beagleboard.tar.bz2 on the 2nd partition like you did before. Did you notice it untar's very quickly?  Why?
 * Boot and explore. What's there?  What's missing?

Congratulations you've just build Linux from source. Try this: beagleboard login: root root@beagleboard:~# cd /sys/class root@beagleboard:/sys/class# ls -F bdi/         hwmon/        misc/         scsi_generic/ usb_device/ block/       i2c-adapter/  mmc_host/     scsi_host/    usb_endpoint/ bluetooth/   i2c-dev/      mtd/          sound/        usb_host/ bmi/         ieee80211/    net/          spi_master/   usbmon/ display/     input/        regulator/    spidev/       vc/ firmware/    leds/         rtc/          thermal/      vtconsole/ gpio/        mdio_bus/     scsi_device/  tty/ graphics/    mem/          scsi_disk/    ubi/ This is a list of low-level devices on the Beagle that you can access as files. Try: root@beagleboard:/sys/class# cd leds/ root@beagleboard:/sys/class/leds# ls -F beagleboard::usr0@ beagleboard::usr1@ root@beagleboard:/sys/class/leds# cd beagleboard\:\:usr0 root@beagleboard:/sys/devices/platform/leds-gpio/leds/beagleboard::usr0# cat trigger none nand-disk mmc0 mmc1 [heartbeat] This is a list of values you can assign to trigger. Notice LED0 is blinking on and off right now. Try: root@beagleboard:/sys/devices/platform/leds-gpio/leds/beagleboard::usr0# echo none > trigger root@beagleboard:/sys/devices/platform/leds-gpio/leds/beagleboard::usr0# echo 1 > brightness What happens? Play around. Here are instructions on reading the USER switch. Try it. Can you make the LEDs blink in response to the button being pressed?

Step 7 - Building a complete Beagle demo image
Now let's build the how demo we were running before. We'll do this via bitbake, but argument do we give it? Try looking in, do you see a recipe that might work? Hint: It has beagle in the name. Here's what I tried. $ time bitbake beagle????-image Replace ???? with the recipe name you found. I added the time command so I could see how long it takes to run. My run took some 7.5 hours.

If you're having trouble with Gimp and/or gnumeric, consult ECE597 OpenEmbedded Issues and Problem_Solving.

Step 7.5 Building a complete unstable Beagle demo image
I did not have as much luck getting Ångström working in the stable OE branch, but I was able to make dev work. You should see that there are two branches available to to choose from. $ git branch org.openembedded.dev
 * stable/2009

So switch to the .dev branch by saying

$ git checkout org.openembedded.dev $ git pull # may not be needed

The OE dev branch does not ship with its own version of bitbake, so you will need to obtain bitbake from another source. Compiling from the OE dev branch seems to require an up-to-date version of bitbake. Install this by running

$ cd ${OETREE} $ wget http://download.berlios.de/bitbake/bitbake-1.8.18.tar.gz $ tar -xvf bitbake-1.8.18.tar.gz This will download and unpack version 1.8.18 of bitbake. Currently, this version seems to work well with the OE dev branch. You must now edit the path that points to bitbake in the source-me.txt file so that it will point to the directory containing this version of bitbake. You should change the line containing

PATH=${OETREE}/openembedded/bitbake/bin:${ORG_PATH} to the following:

PATH=${OETREE}/bitbake-1.8.18/bin:${ORG_PATH} NOTE: If you have modified the  setting in   to contain only , your build may fail due to missing required locales. You should have this set to  for the build to be successful. If you local.conf file does not have a line containing, your build still should be successful as it will, by default, include all available locales, including those mentioned above. Can you figure out where this list of locals came from?

We must now wipe out our stable build directory, as the two branches are not compatible. (Feel free to make a backup if you feel inclined). $ rm -rf ${OETREE}/angstrom-dev/

Now you may follow the directions above by running $ time bitbake beagle????-image

This will take a VERY long time, as it must recompile everything that was done previously. On my E8400 it took 10.4 hours to run with all locales, and 9.3 hours with only the ones I needed. It also used 17gb of space.

Once it has finished take a look in $ ls ${OETREE}/angstrom-dev/deploy/glibc/images/beagleboard

You should recognize the files from when you previously installed Angstrom, if not re-read ECE597_Getting_your_Beagle_running_(precompiled)

The first boot of my beagle took a very long time...a few minutes (subsequent boots are faster), the beagle will hang on the below screen for a while, just let it go and it will continue. INIT: version 2.86 booting Error. Cannot create canvas. Abort.

I also saw a lot of these errors, again you can probably ignore them. (if you can figure out how to fix, post fix here) Cannot find fifo at /mnt/.splash/exquisite. To fix it just do: opkg remove exquisite opkg install psplash-angstrom It will some speed up boot (it will not hung for a few min after INIT: version 2.86 booting). But you will not see Angstrom boot-logo and a boot progress bar. But if you get this error, probably you did not see it anyway.