DragonFly has generally shifted over to dports for 3rd-party software management, away from pkgsrc. Because of that, I haven’t been building binary packages of the quarterly pkgsrc releases. Pierre Abbat asked why on users@, and here’s my explanation of the change.
Month: September 2013
If you’re around New York City on Wednesday, Boris Kochergin will be giving a talk at the NYCBUG meeting about how he and his employer, New York Internet, managed to be in the middle of Hurricane Sandy and survive without interruption.
That same announcement lets drop the news that NYCBSDCon will happen next February
John Marino has put in a large patch to DragonFly 3.5, updating all sorts of language-related items. As he warns, you will need a full buildworld/buildkernel in a specific order to update. On the plus side, you can now probably use your native language for nvi and for git.
Moved 20 servers to new hardware this week. Normally my workplace doesn’t get very active until snow hits. Normally. Anyway, going for the long sentences this week.
- Why I moved away from Microsoft ASP.NET. I agree with everything in this. I’m overgeneralizing, of course, but there’s a certain diminishing return in how easy you make any programming language.
- In which I revisit the pastimes of my misspent youth. The last 2 sentences are a nerd experience I am sure we’re all had.
- The Floppy ROM. Software via record. If you ever wanted to be able to see a head crash as it happens on your storage medium, this is the way. (via)
- Chart of Electromagnetic Radiation. You’ll need to/want to zoom in. (via)
- The Practice of Network Security Monitoring. I’ve linked to a review of the book before.
- Paula Deen X Machine. Baked goods and graphs, two of my favorite categories of thing. (via I forgot, sorry)
- The new Amazon tablets are nice, but there’s no video out. You have to use their network service. This is what makes me leery of newer tablets and phones; as it becomes easier to use network bandwidth to replace physical connections, you become dependent on a separate company to use your own hardware.
- Vim documentation in PDF form. Maybe print it, maybe don’t. (via)
- Salesforce Architecture. I like seeing how the really, really huge server setups work, but I doubt I’ll ever have to handle one; how many are there outside of Google/Amazon/a couple other companies? (via)
- Obstacles to future proofing home automation. At that level of hardware, you can’t assume everything’s going to talk 802.11 or have an Ethernet port.
- Tape rescues big data. I need to set up a larger backup system at work, and it might be tape. I hate tape, but I hate it less than the alternatives.
Your unrelated link of the week: Proper Opossum Massage. Yes, it’s a serious video, but it shouldn’t be taken seriously.
This week was relatively quiet, but also had the most cross-BSD work I’ve seen in a while. Look at the links and you’ll see.
- Here’s some encryption fallout in FreeBSD.
- MegaRAID Invader cards now work on FreeBSD.
- OpenSSH is at version 6.3p1 in FreeBSD.
- FreeBSD has moved to Unbound as a BIND replacement.
- FreeBSD imported a newer version of NetBSD’s readline.
- NetBSD supports the AlphaStation DS15, ported from OpenBSD.
- OpenBSD has updated le(4) to match NetBSD’s version.
- OpenBSD has also moved to Unbound – version 1.4.21.
- OpenBSD now has ldns 1.6.16.
Here’s more on Unbound, since it seems to be a trend.
If you want to boot from a Hammer 2 /boot volume, you now can. Hammer 1 never worked well as /boot, though it was technically possible. Hammer 2 will be just fine.
Note that you can’t turn on recently-added disk compression since the bootloader doesn’t understand it, and Hammer 2 is not ready for anything but being worked on. Don’t try it unless you’re ready to be submitting code changes to fix Hammer2.
This will not be a surprise to anyone seeing the work being done, but: All 5 DragonFly/Summer of Code students for 2013 passed, as noted today in emails from Google. It was possibly our best year yet in terms of buckling down and just plain working.
Francois Tigeot posted his work on the KMS driver for Radeon video cards. He’s looking for help since he’s low on time for the immediate future, and this is a project that could benefit everyone. (Well, everyone with the right video card.)
Joris GIOVANNANGELI and Pawel Dziepak both have published final reports for this year’s DragonFly/Summer of Code experience. Both of them say they want to keep working on DragonFly, which is exactly the result I want. There may be more if the other students have time. A final report wasn’t required, but it is good feedback.
Related: Joris is working on Capsicum for DragonFly and published an API document describing how it has worked/will work.
Please welcome our newest committers: Joris Giovannangeli and Mihai Carabas. Joris has already updated bc(1) and dc(1) to match what OpenBSD has. You may recognize Joris’s name from his just-finished Google Summer of Code project for DragonFly, and Mihai Carabas from both this year’s and last year’s Summer of Code.
Matthew Dillon’s committed the work by Daniel Flores on Hammer 2 compression and Mihai Carabas’s vkernel hardware support – both Summer of Code projects. There’s a good amount of detail in the commit messages describing the work and what it changed; I expect more Summer of Code work to be getting committed…
Note: you’ll want to do a full update.
This week, the sewer drain for my house clogged. Fixing that is not fun. What is fun is reading random semi-technical articles around the Internet. So get clicking!
- Avoiding Repetitious Work with Sed. I know I’ve never used awk and sed to their full potential, but… it’s kinda not fun.
- Bunnie Huang goes to Burning Man 2013, and remote-controlled flamethrowers result.
- The shocking truth behind Tetris. (via)
- The USE Method: Linux performance checklist. This would be interesting to migrate to BSD – and then try it as a comparison method between the various BSDs. (via)
- A Brief History of Lisp Machines. I find these machines built around a language interesting, especially since they are extinct. (via)
- The Walkman Archive. (via)
- Vim as a presentation tool. (via)
- The First Critical Hits. Role-playing game history. (via)
- Kickstarter for open source. (via)
- Tracking disk space usage. Of course, doesn’t work the same way on Hammer.
- Atari box art.
- Atari box art parody.
Finally, a quieter week.
- pfSense (which I use at work; performs great) has updated to 2.1, and now offers a ‘Gold‘ subscription program.
- FreeBSD has a new iSCSI target and initiator. (World rebuild needed and again)
- FreeBSD’s bxe(4) now supports the BCM57712 and BCM578XX.
- FreeBSD now can build LLDB, though you have to do it on purpose.
- FreeBSD’s arcmsr(4) driver for Areca hardware has been updated. (Areca supports BSD; buy them)
- NetBSD has Renesas and ASIX AX88179 USB support.
- NetBSD has a preliminary NVIDIA Geforce driver.
- NetBSD has updated to dhcpcd-6.1.0.
- NetBSD has updated to tzcode 2013e.
- QNAP V200 boards all have the same MAC? Weird.
- OpenBSD updated a large number of xenocara windowing parts.
- The pkgsrc-2013Q3 freeze is on from now to the 29th.
I put together a list of what I’m thinking could be in the next DragonFly release. Going by our regular schedule, that’s a bit more than a month off. Of note: Summer of Code material and defaulting to dports. Follow the thread for more.
Something I only just recently found out about: BSDNow. They’re planning weekly videos with BSD news and interviews. I say ‘planning’, but as of this writing, both Episode 1 and Episode 2 (which is much better quality) are already available.
Another episode is planned this week. Episode 3 is out already.
ZFS was originally created at Sun and open sourced. Sun was absorbed by Oracle and stopped being open (or even really existing), so ZFS was taken up by several separate groups – FreeBSD and Illumos being two examples. OpenZFS has been announced, in part to provide common reference for other platforms that might implement it and probably to avoid capability fragmentation. It’s certainly a good idea.
(If I have my history wrong, please correct me.)
DragonFly has two included compilers – GCC 4.4, and GCC 4.7. Traditionally, we switch from one compiler to the other as default, and then replace the old one with a newer release, and so on.
Until recently, dports built almost exclusively using GCC 4.4. John Marino’s switching to GCC 4.7, for a variety of reasons he lists in a recent post to users@. An interesting point that he raises: GCC 4.4 won’t necessarily be replaced with a newer GCC, but perhaps clang?
Michael W. Lucas needs tehcnical reviewers for his first draft of ‘Sudo Mastery’. If you know sudo, and know how to criticize (and who doesn’t, for this is the Internet), look at what you’d have to do.
We’re in the last week of what has been a very good Summer of Code for DragonFly, and here’s the last reports. (We’re missing two, but this is cleanup week, so not much to report)
- Daniel Flores: HAMMER2 compression feature
- Larisa Grigore: System V IPC in userspace
- Pawel Dziepak: Make vkernels checkpointable (updated)
- Joris GIOVANNANGELI: Capsicum (Joris, where’s your report?)
- Mihai Carabas: hardware nested page table support for vkernels
I don’t think I saw it before, but there’s a list of speakers and events up for vBSDCon. There’s no DragonFly-specific talks, but there is a presentation from Baptiste Daroussin, one of the people behind pkgNG, which is used to create parts of DragonFly’s dports framework.
It’s positive to see a BSD conference sponsored by a company that’s not selling a BSD-specific product. It’s happening in about a month and a half, October 25-27, in Dulles, VA.
I think I’m finally catching up on the backlog.
- Unix: Flexibly moving files with lftp. I usually copy and paste a shell script together.
- BANCStar source code. In that sort of environment, there’s no good or bad code. It has moved beyond such considerations. (via)
- The Lenna Story. About the 1972 Playboy centerfold image used to test image compression. I mentioned it once before in passing. (via)
- If you find regular expressions difficult, putting another layer of expression on top doesn’t help. (via)
- How not to check the validity of an email address. I had a similar experience at an old job in 1999, where a coworker set a site’s main page to get all news stories and then showed the 10 most recent. This started to really slow things down when we reached over 5,000 stories… (via)
- Achieving Rapid Response Times in Large Online Services. A PDF of slides. (via)
- It’s described as “the best programming fonts“, but it’s really the most popular monospaced typefaces. Who cares about correct language – it has visual examples. (via)
- Phone keypads could have been very different. (via)
- Sudo Mastery’s first draft is complete. You can buy it now and get updates as it gets polished.
- Have yourself a keysigning party. GPG is complicated. I know there’s reasons, but still, this is the sort of thing that would be better with as little barrier to entry as possible.
- The Internet, via Commodore64 and Neuromancer.
Your unrelated link of the week: The Alan Lomax recordings.
Barely getting this done in time for Saturday…
- FreeBSD can now download firmware for Samsung drives.
- FreeBSD has updated ipfilter to 5.1.2.
- FreeBSD has updated to OpenPAM Nummularia.
- On FreeBSD, clang means no gcc or libstdc++. (part of the switch)
- FreeBSD has new Hyper-V drivers.
- NetBSD has support for the ‘4G Systems XS Stick W14′.
- NetBSD has updated Postfix to 2.8.15.
- NetBSD has a pile of Broadcom chipset changes.
- NetBSD has support for the MPL115A2 pressure sensor.
- NetBSD has a start on xhci (AKA USB3) support.
- OpenBSD has support for the FreeScale i.MX6 SoC.
- OpenBSD enabled support for TLS/SSL Perfect Forward Secrecy.
- OpenBSD 5.4 is available for pre-order.
- OpenBSD used to build an MPLS network.
- PC-BSD is going to start building on FreeBSD-10.
- The pkgsrc-2013Q3 pre-release freeze starts tomorrow.
I know this is late; my schedule is a bit messed up. This is the penultimate week!
I’m just going to roll all these updates from Sepherosa Ziehau together into one post, because it’s a lot: He’s updated igb(4) to 2.3.10, updated em(4) to 7.3.8, merged the hardware abstraction layer of those two drivers, enabled TSO on all PCI-E em(4) chipsets, and added support for a whole slew of Realtek chipsets in the re(4) driver. Whew!
If you’ve got a MCP79 NVIDA-chipset board, Sascha Wildner’s commit of Ed Berger’s port from OpenBSD has you covered.
By the time you read this, I’ll have already been sitting on an island for a few days. There’s so much stuff to post lately I’m scheduling material a week out.
- Have you used the grep replacement ‘ack‘? There’s a Twitter feed of tips for it.
- A horrible programming idea, so bad I can’t tell if it’s trolling. (via multiple places)
- Links at the previous item led me here: Breaking Systems for Fun and Profit.
- A tiny fatmac. It’s adorable.
- Beautiful Code, from Rob Pike, described by Brian Kernighan.
- That previous link was found via this reimplementation of Pike’s grep in Go. The “Practice of Programming” book mentioned is one of my favorites.
- The SCUMM Diary. The SCUMM engine could arguably be as big an influence as the Quake engine on game history. (via)
- This is a very nice keyboard.
- Managing sshd in Ansible, cross-platform. A sequel to last week’s Ansible/Lucas link.
- UNIX pioneers remember the good times. These anecdotes seems to illustrate the personalities of their tellers/perpetrators. Or at least I imagine they do. (via)
- NTP reference clock statistics. (also via) When milliseconds matter. Also, yay graphs!
- WTF Visualizations. A counterpoint to the previous well-illustrated link. I read through a bunch of the nonsensical graphs and started to feel disoriented. (also also via)
Your unrelated comic link of the week: The Scout, by Malachi Ward. A self-contained sci-fi story.
There’s been a lot of commit activity across the BSDs, but my list doesn’t seem to reflect that. A lot of incremental work, I suppose.
- FreeBSD has imported the multiqueue VirtIO driver
- FreeBSD has added support for the BCM20702A0 chipset, for Bluetooth adapters.
- FreeBSD can now reach single user mode with Digi i.MX53 / Wi-i.MX53 boards
- FreeBSD supports Synaptics touchpad middle and extended buttons. (Breaks ABI)
- FreeBSD has improved disk encryption speed with AES-NI.
- FreeBSD has updated bmake to 20130904.
- FreeBSD has added support for the DLINK DWA-127 wireless adapter.
- NetBSD has updated to llvm/clang r189662.
- Joyent has put together potential SMF support for pkgsrc.
- PC-BSD has been synced with FreeBSD 9.2.
- NetBSD has bare support for the Cubieboard 1 and 2.
- NetBSD has updated to version 458 of less.
- NetBSD has the beginnings of a Synopsys DWC2 (USB controller) driver.
- OpenBSD has imported Mesa 9.2.0.
- OpenBSD has added the ugold(4) temperature sensor driver.
Antonio Huete Jimenez has committed his work on “dirfs”, a filesystem that lets you mount directories from your host machine within the running vkernel environment. It’s a sort of shared folders for vkernels. See the commit message for usage details.
Sepherosa Ziehau has made a number of improvements to TCP in DragonFly – specifically, nonblocking and blocking connect(2) performance. See each of his commits for statistics on how much this has reduced processor use under high load. He has also written up an extensive description of how all this TCP stuff works in DragonFly.
In similar news, he has a nginx patch that delivers a significant performance increase. It may go into nginx itself.
Almost done with this year’s GSoC. It’s been astonishingly… easy? The students are working and the problems are difficult, but there’s been very little in the way of crisis.
In BSDTalk 213, Will Backman talks to a number of people about the FreeBSD Documentation Project. It’s about 14 minutes and it comes from the recent BSDCan 2013 event.
Another week of links completed early. And there’s a lot, so get clicking!
- 1BSD, the installation. Interesting to see the procedure and the tools used.
- Over the Rainbow, polychromatic type from Microsoft. I don’t know if this is as exciting as they seem to think it is.
- Do your own backups. Yeesh, what an unfortunate event. I’m fixing up my backups now, after my own troubles.
- Operating System Development series. Dry but interesting. (via)
- Windowing operating systems are too messy, too restrictive. From 1984. (via)
- Home Automation via the Internet. For those who don’t want to deal with x10.
- Chess implemented in Sed. No en passant? Sheesh, I was on board until that point. (I’m making a joke) (via)
- Managing sshd in Ansible. Ansible’s getting more popular, it seems.
- Remember that PDF compression/scanning error I mentioned a few weeks ago? Xerox has fixed it for their devices, and the patch is available. One of the ways to apply the patch is to print the file to a copier, via LPR/raw. Firmware updates via printing – that seems like a good and bad idea all at the same time.
- An XKCD cartoon slightly related to the previous link.
- Learn to code. (via)