I need to update this post during the week as I see stuff, or else I spend an hour rushing to get it all together before Satuday. I need to start watching PC-BSD src changes, too.
Sascha Wildner has ported rum(4), run(4), and urtwn(4) from FreeBSD to DragonFly, to work within the not-yet-default new USB framework. This happened some days ago, but I’m just now catching up.
avalon.dragonflybsd.org, also known as mirror-master, is the final dragonflybsd.org system to be moved into the new colocated blade server. Your downloads of binary packages or DragonFly images should be speedier.
Remember my recent disk issues? As a side effect of protecting myself, I have a good example of deduplication results.
I have a second disk in my server, with slave Hammer PFSs to match what’s on my main disk. I hadn’t put them in fstab, so they weren’t getting mounted and updated. I got them re-created, but they were nearly full. Here’s an abbreviated df, from which you should be able to tell which drives I have :
Size Used Avail Capacity
929G 729G 200G 78% /slave/slavehome
929G 729G 200G 78% /slave/slavevar
929G 729G 200G 78% /slave/slaveusr
929G 729G 200G 78% /slave/slaveslash
That 78% is how full the Hammer volume was. I turned on Hammer deduplication, since it’s off by default. The very next day:
Size Used Avail Capacity
929G 612G 318G 66% /slave/slavehome
929G 612G 318G 66% /slave/slavevar
929G 612G 318G 66% /slave/slaveusr
929G 612G 318G 66% /slave/slaveslash
It’s a 1 terabyte disk, and I gained more than 10% back – That’s 100g of disk space that I gained overnight. There might be more tomorrow, given that it was all of 5 minutes of dedup work.
This won’t surprise you if you’ve seen previous deduplication links here, like my previous results or some real-world tests. It’s still great. I’d suggest turning it on if you haven’t – hammer viconfig the appropriate PFS and uncomment the dedup line.
There’s several debates exclusive to the Unix-like world: Vi vs. Emacs, System V vs. BSD, and so on. A more recent one that people tend to fragment over is XML in config files vs. anything else. Read through this recent threa, starting here, about SMF (which became about XML) on users@.
Only 3 more Mondays left in the student work part of Summer of Code! Unsurprisingly, it seems the students are mostly in the cleanup phase – as it should be.
I’ll be working on the 3.4.3 release of DragonFly within the next 24 hours, and it should be available this week. I’ll have a list of the bugfixes it contains…
This week, I’m opinionated on every link.
- An 80s computer ad that got almost everything correct. It used to be sci-fi environments were super-clean – now they’re dirty, with ubiquitous electronics. That’s something that could be picture-blogged to prove, but I ain’t doing it.
- Bunnie Huang does “exit interviews” when he stops using equipment. Given his electronics knowledge, he goes into a lot of detail, including pictures through a microscope. Speaking of this, how has my ancient HTC Incredible survived 3 years of trips into a salt mine? I don’t know.
- InterTwinkles, open source group decision making software. Don’t know how well it works, but it certainly seems like the right idea. (via)
- Turning the Apple //e into a Lisp machine, part 1. They don’t actually get to the Lisp machine part, but it talks about how Apple computers could load data through the audio jack. I remember doing that with a tape player, too. It sucked. (via)
- kOS. It’s so minimal that I am not sure what it can do or how to use it, but it’s also so minimal that I’m sure there must be something to it. (via)
- Building a Chording Keyboard. I’ve mentioned the Microwriter and Twiddler before, but this article goes into a lot of detail about the actual construction of a home-made unit. (also via)
- Book review: The Healthy Programmer. It may or may not make you exercise, but it will make you feel a little guilty about sitting and reading the web like you are doing right now.
- Hyphen, en dash, em dash, minus. So few people know there’s a difference. (via)
- ASCII Art. History of, examples, and so on. (via, with video)
- Five Useful Git Tips. Git tips come up all the time, but this one is interesting because it’s using “showterm“, which lets you make text-based animations? movies? to show a work process in a terminal. I think I may have linked to something similar before, but this is good.
- How to Avoid the Emacs Pinky Problem. A neat idea, but some of the suggestions are actually going to make it worse. (via)
- Vim: revisited. Decent ideas, and the links at the end are good further reading. There, I’ve posted on both sides of the editor issue. (via)
- The problem with Vim. (via)
Your unrelated link of the week: the Scary Godmother Doll. One of my favorite illustrators, building a doll. I met the creator years ago in Pittsburgh; she is an astonishingly energetic person.
I hope I’m catching the interesting stuff; I’m only reading the src changes.
It’s really neat to suddenly encounter something done just for DragonFly that you didn’t know was coming: A port of Go to DragonFly. I think these changes are going into the next Go release, or at least I hope so. (More on Go if you haven’t encountered it before.)
Just seen: EdgeBSD, a version of NetBSD with different goals in mind. (Seen on Hacker News)
Michael W. Lucas has a short article up about sysrc, a FreeBSD tool for handling rc.conf across multiple machines. This could easily be a cross-BSD tool – hint, hint.
Update: as Sascha Wildner pointed out, rcrun covers that in DragonFly. Mostly I’d like to see the same interface, then, I guess?
If you’re curious about the hardware being used for the colocated dragonflybsd.org servers (this includes the website, the repository, the mailing lists, dports build machines, etc.), here’s the ‘MicroCloud’ product page. DragonFly’s model was purchased from iXsystems. Apparently those Haswell processors have a fantastic power consumption to performance ratio. (via)
I’m running a bit behind because I’ve been on the road, but here they are:
Had this one done before the last Lazy Reading. There are so many things to see and think and do in a day, and they’re not even all on the Internet. You get only the Internet ones here, though.
- Slashdot founder Rob Malda on why there won’t be another Hacker News. Found on Hacker News, of course, and I suspect the title was designed to get clicks from there. Some interesting thoughts on how people read.
- Facebook is like a television that monitors to see how much you are laughing and changes the channel if it decides you aren’t laughing hard enough.
- Unix routing. It’s actually Linux routing, but if you avoid the Linux-specific parts, it’s a useful introduction.
- ASCII cheat sheet.
- How to build a user-level CPU profiler. Followed by Hacking the OS X Kernel for Fun and Profiles.
- Mediagoblin. I haven’t tried it, but the idea is a good one. As long as we don’t have to call it GNU/Mediagoblin.
- I was going to make a joke about not using software I can’t name out loud without sounding incomprehensible, but then again, I’m using BSD. Too late for that joke.
- The Future of Programming. Take the time to watch this. The list of resource links is enough to fill several afternoons with reading. Also, it’s not yet another TED talk where someone is trying to communicate excitement rather then information. (via)
- If I’m going to link to Reggie Watts, why not look at one of his music videos? Normally that would be an Unrelated Link, but I just made it related from the previous item, yay! (link contains naughty language.)
- Go for system administrators. (via)
- Git + webcam = lulz. This could be fun or scary or both. (via)
- Retro video games, delivered. (via) I still hope to build a MAME box someday.
- 0.9999999999 repeating = 1.
Your unrelated comics link of the week: Boulet’s Long Journey. Get ready for a lot of scrolling. I know there’s a lot of really good French comics that I don’t see just because I don’t speak the language. (This one’s in English, but the cartoonist is French.)
Not just source links, this week:
One of the most-requested items for the DragonFly mailing list archives is reverse sorting by date. Mailman, which is what’s being used now for archiving, doesn’t have a ‘native’ way to do that. Has anyone seen a trick/patch to get that to happen? I already patch Mailman to get the message date to show in listings.
Sepherosa Ziehau suggests this relatively easy task: adding a TSC cputimer to vkernels. Apparently most of the framework to do this is already in place.
Michael W. Lucas has a review up of Richard Bejtlich’s “The Practice of Network Security Monitoring“. Both of them are long-term BSD users, and Bejtlich, if I remember correctly, was part of the design of Capsicum, the security framework that is serving as a Summer of Code project for DragonFly right now. So it’s worth looking at his book. And/or looking at his blog, for those who want more.
I’m a bit slow in posting this, but that’s OK since it’s a work in progress: Markus Pfeiffer has added some more work on USB4BSD porting to DragonFly, including some device–specific changes.
BSDTalk episode 230 is out. It’s 12 minutes of conversation with Burt Kaliski, CTO of Verisign, about the upcoming newest BSD convention, vBSDCon.
Maybe the title of this post doesn’t rhyme, but it does in my head. Michael W. Lucas is looking for people with interesting sudo setups, for his upcoming book.
I’d be really surprised to find this affects anyone, but it’s possible: some kernel options specific to Cyrix processors have been removed, by Sascha Wildner.
Registration is open for vBSDCon, happening in Dulles, Virginia, USA, on October 25th through 27th. There’s some neat-sounding presentations listed.
I think that is the same location where I went to a rather spectacular pre-dotcom-crash presentation from Time Warner/Road Runner back in 1999. The hotel was great; the presenters were befuddled. An internal account manager ran up a $3,000 bar tab in one night on a company credit card… I still have the fancy Guinness glass he bought me. I don’t think this convention will work exactly the same way, but unlike my 1999 trip, the speakers at this one will actually know what they are talking about.
If you look at the reports from students this week, they are mostly “I had bugs and I fixed them and there’s not much to do other than test”, which is the sign of well-planned projects. Here’s the status reports:
If you missed Michael W. Lucas’s talk about DNSSEC, it’s recorded and available on Youtube. Or buy his book.
shiningsilence.com suffered a disk failure early this morning. I’ll take the opportunity to set up a new machine, given that my local backup drive hasn’t been mounted and my remote backup went offline, in a horrible coincidence.
The disk is up and limping, which is why you can read this, but I’m still rebuilding. What motherboard/CPU/RAID/etc. parts do people recommend?
Again, lots of links. Some of these are overflow from previous weeks where I just said “That’s enough; let’s work on the next Lazy Reading.”
- Perl, the Detroit of scripting languages. The slides are entertaining, but it’s also interesting for the discussion of how to handle a very old code base and a community. (which are BSD issues too) (via)
- Ruins of Forgotten Empires: APL languages. “APL uses one thread per CPU, which is how sane people do things.” (via)
- Remember when we used mega- prefixes to measure disk and memory, and not bandwidth?
- Ian Lance Taylor’s 20-part series on ELF linkers and linking. (via EFNet #dragonflybsd)
- PDF compression formats. Incidentally, here’s an answer on the Xerox number alternation issue, where compression means one number gets misidentified and substituted for another. The Economist has a not-crazy take on it. It’s not a Xerox problem but rather a JBIG2 compression issue. I have a number of Xerox models at work and have not seen this issue, but also haven’t checked for it.
- OSI, the Internet That Wasn’t. People only ever care about levels 1, 2, 3, and 7 in the OSI model. And this joke. (via)
- The Toshiba Libretto. You can get more powerful, smaller computers now, but they’re cheap netbooks and totally uncool.
- A crash course in tmux. (via)
- Whatever room you keep your primary computer in – clean it, please.
- Robots for destroying buildings. This is not some speculative article; these are robots you can buy right now. Screw the flying cars joke everyone makes; the future is now. (via)
- How to shutdown computer under Linux? A rough summary of how Linux can be a moving target for actual usage.
- Vim 7.4 out, mostly so there isn’t so many patches to apply.
- Goto is making a comeback. (via Eric Radman)
Your unrelated link of the week: Mighty Taco radio ads. Mighty Taco is a Mexican fast food place from Buffalo, New York, USA. It’s about as authentically Mexican as fast food from a city on the edge of Canada can be, which is ‘not much’. I’ve always loved the food, though, and the commercials are just the right mix of amateur joke and commercial advertising.
Bonus unrelated: If you enjoy imgur/fukung but it’s not youtubey enough, hit ‘Random’ on IWantMoar.com a few times. You may want to turn down your volume.
Or at least scheduled to happen now, since I’m posting this and postdating it for everyone as a reminder. I hope I have the time right.
The mailing list archives for DragonFly (lists.dragonflybsd.org) have been moved to new hardware. (Yay!) The patch that actually shows date in the listings needs to reapplied, cause Mailman is somewhat stale. (Boo!) I applied the patch and I’m regenerating all the archives now. (Yay!) There’s some garbled messages in the archives that cause a bunch of “no subject” partial messages to be dumped at the end. (Boo!) I’ll manually fix them if I can, someday. (Yay?)
Definitely Saturdays for this summary. In other BSDs this week:
Wired has an article up about Jordan Hubbard and his move from Apple to iXsystems. It’s not a bad article, though it doesn’t delve into the why of BSD very much. In any case, iXsystems has been really bulking up lately to be more than a generic hardware provider.
Speaking of which, that blade system going in now for dragonflybsd.org was sold by iXsystems.
Several parts of dragonflybsd.org are moving to a new blade server, so there may be some service interruptions during the transition.
Francois Tigeot has ported TTM to DragonFly from FreeBSD and I think a bit from OpenBSD. All this work has led to an update in the driver porting notes.
Michael W. Lucas’s next topic in his Mastery series is ‘Sudo‘.
It’s 24 minutes with Chris Cappuccio, talking about nsh and flashrd for OpenBSD.
Everyone passed their Summer of Code midterms! Not that this was a surprise; all the students have been consistently working and overcoming problems, but a 100% pass rate makes me happy.
Here’s the status reports:
On August 10th, Michael W. Lucas will be giving a talk on DNSSEC to the Metro Detroit Linux Users Group, and it’ll be livestreamed for everyone to see. His talks are energetic and entertaining, and it’s worth making time to see.
Joris Giovannangeli, one of the Summer of Code students for DragonFly, posted his thoughts on credential descriptors – have a read. He is working on capsicum and DragonFly, so this is a natural thought process.
These have been very easy to create over the last few weeks; there’s been a torrent of reading. Can I say torrent without making it sound like this is all downloaded large files? The word is overloaded. Anyway:
Your unrelated link of the week: What goes on when you are not there!
How many tags can I fit on this post? I think I’ll aim for Saturday for these BSD catchup posts. In theory, I can prep this and the Sunday Lazy Reading posts ahead of time, since they tend to be all-week items, and have the whole weekend covered.
If you have a computer with one of the very-very-new Haswell processors from Intel, Matthew Dillon has made some changes that will interest you. They shave off (in the example given) about 20% of CPU power usage without much effect on performance.
killall -T will now kill all processes associated with the current tty, except parents of the killall process itself. It’s a shortcut to “kill all these runaway items I started by accident”.
Thanks to the effort of a number of people, DragonFly (-current) now supports KMS and accelerated video on Intel 915 chipsets. It’s 2D and x86_64 only for now, but it’s much, much better than just using the vesa driver.
Every year, people ask “Why can’t writing documentation be part of Summer of Code?” (Not necessarily for DragonFly, but in general) Google has a “Doc Camp”, where a whole lot of documentation gets produced in sprints, and anyone can participate – not just Summer of Code students.
If this sounds interesting to you, your application has to be in by August
7th 9th. (URL and date updated)