Skip to main content.

Virtualization with bhyve

2014-01-15

Live demo in BSD Now Episode 020 | Originally written by Allan for bsdnow.tv, with minor edits | Last updated: 2014/01/15

Virtualization has been a hot topic for a while now, and there are lots of options for it. On FreeBSD, there's the often-copied jail feature. For a lot of use cases, that's ideal. There's no overhead, they're very secure and they offer supreme flexibility. However, sometimes people need to use other operating systems. You could use a userland application like VirtualBox, but performance leaves something to be desired. There are times when performance needs to be at the top of the list. For those times, you'll need something else.

You'll need bhyve.

Short for the BSD Hypervisor, bhyve is a great virtualization technology in the vein of Xen or KVM, but done BSD style and without legacy support. It's a type 2 hypervisor that lets you run other operating systems under FreeBSD. It was officially released in FreeBSD 10.0. So enough talking, let's get it set up. Keep in mind that bhyve requires an Intel CPU with VT-x and Extended Page Table support.


FreeBSD

Start off by creating a disk image to use for the VM. We'll use a 10GB file.

# truncate -s 10g bhyve1.img

Load the bhyve kernel module.

# kldload vmm

Create a bridge and your tap network interface.

# ifconfig bridge0 create
# ifconfig tap0 create
# sysctl net.link.tap.up_on_open=1

Add your LAN interface and the tap interface to the bridge. The NIC is called igb0 in this case.

# ifconfig bridge0 addm igb0 addm tap0
# ifconfig bridge0 up

Download a copy of FreeBSD to install.

# fetch ftp://ftp.freebsd.org/pub/FreeBSD/ISO-IMAGES-amd64/10.0/FreeBSD-10.0-RC5-amd64-bootonly.iso

Copy the template bhyve script. (Official Instructions)

# cp /usr/share/examples/bhyve/vmrun.sh bhyve1.sh
# chmod +x bhyve1.sh

Configure the number of CPUs, amount of ram, name of disk image.

# vi bhyve1.sh

Start bhyve in installation mode.

# ./bhyve1.sh -i -I FreeBSD-10.0-RC5-amd64-bootonly.iso fbsd10

Do an install as usual, but at the end, choose to enter a shell on the installed system. Because bhyve does not emulate a graphics card, only a serial console, we need to configure the system to boot with the serial console.

# vi /etc/ttys

Change this line:

console none    unknown off secure

To the following:

console "/usr/libexec/getty std.9600"    xterm   on  secure

Now, restart the vm, and choose reboot from the beastie menu to exit.

# reboot

Rebooting exits bhyve, so lets start it again without the install disk.

# ./bhyve1.sh fbsd10

You now have a working FreeBSD in bhyve.

# reboot

Select reboot, or hit ESC and type quit, from the beastie menu to exit. The vmrun script tries to keep your vm running so restarts it when it crashes/exits.


OpenBSD

This requires the grub2-bhyve port. Install it via ports or pkgng. Create an OpenBSD tap device and add it to the bridge

# ifconfig tap1 create
# ifconfig bridge0 addm tap1

Download this working OpenBSD image:

# fetch http://people.freebsd.org/~grehan/flashimg.amd64-20131014.bz2
# bunzip2 flashimg.amd64-20131014.bz2

Create a grub device map, obsd.map, containing:

(hd0) ./obsd.img
Booting the OpenBSD image:
grub-bhyve -m obsd.map -r hd0 -M 512 obsd

This will start grub, enter the following:

kopenbsd -h com0 (hd0,openbsd1)/bsd
boot

Start bhyve

# bhyve -c 2 -m 512M -A -H -P -s 0:0,amd_hostbridge -s \
  1:0,lpc -s 2:0,virtio-net,tap1 -s 3:0,virtio-blk,obsd.img -l com1,stdio -W obsd

The image may fail to boot because it was shutdown improperly, restarting it should resolve this. The root password is: test123

Clean up the VM:

# bhyvectl --destroy --vm=obsd

This tutorial is ongoing and will be updated at a later time to include autostarting.

Latest News

How did you get into BSD?

2014-11-26

We've got a fun idea for the holidays this year: just like we ask during the interviews, we want to hear how all the viewers and listeners first got into BSD. Email us your story, either written or a video version, and we'll read and play some of them for...

EuroBSDCon 2014

2014-09-18

As you might expect, both Allan and Kris will be at EuroBSDCon this year. They'll be busy hunting down various BSD developers and forcing them to do interviews, but don't hesitate to say hi if you're a listener!...

BSDCan 2014

2014-04-30

We just wrapped up episode 35 after having some horrible audio issues. Sorry about the quality being lower than usual, we did the best we could given the circumstances. Next week we've got a normal episode, but the following week Allan and Kris will be at BSDCan. That week will...

AsiaBSDCon 2014

2014-03-05

Both Allan and Kris will be going to AsiaBSDCon this year, so episode 28 will be shorter than usual. We'll be back the following week with a huge episode. Hopefully they can get some interviews there!...


Episode 068: Just the Essentials

2014-12-17

Direct Download: Video | HD Video | MP3 Audio | OGG Audio | Torrent This episode was brought to you by Headlines More BSD conference videos We mentioned it a few times, but the "New Directions in Operating Systems" conference was held in November in the UK The presentations videos are now online, with a few...

Episode 067: Must Be Rigged

2014-12-10

Direct Download: Video | HD Video | MP3 Audio | OGG Audio | Torrent This episode was brought to you by Headlines Bitrig 1.0 released If you haven't heard of it, Bitrig is a fork of OpenBSD that started a couple years ago According to their FAQ, some of their goals include: only supporting modern hardware...

Episode 066: Conference Connoisseur

2014-12-03

Direct Download: Video | HD Video | MP3 Audio | OGG Audio | Torrent This episode was brought to you by Headlines More BSD presentation videos The MeetBSD video uploading spree continues with a few more talks, maybe this'll be the last batch Corey Vixie, Web Apps in Embedded BSD Allan Jude, UCL config Kip Macy, iflib While we're...

Episode 065: 8,000,000 Mogofoo-ops

2014-11-26

Direct Download: Video | HD Video | MP3 Audio | OGG Audio | Torrent This episode was brought to you by Headlines Even more BSD presentation videos More videos from this year's MeetBSD and OpenZFS devsummit were uploaded since last week Robert Ryan, At the Heart of the Digital Economy FreeNAS & ZFS, The Indestructible Duo -...