I sort of lost a day this week because of an accidental 20-hour workday, but I still have the links:
Note: corrected VPS hosting link.
Get ready for some reading.
I have been building up quite the variety this week.
- Bitrig 1.0 has been released.
- Writing NetBSD Sound Drivers in Haskell. (PDF, via)
- ruBSD 2014, happening December 13th in Moscow. (via)
- How to configure full disk encryption in PC-BSD 10.1. (via)
- BSD Magazine for November 2014. (via) Why don’t they put new issue announcements in their RSS?
- A week of pkgsrc #5.
- FreeBSD Foundation’s 2014 year-end fundraising.
- FreeBSD Mastery: Storage Essentials is hitting the printers. There’s a quiet mention of the next two books in that series, too.
- Two new kernel errata for OpenBSD.
- BSDCan 2015 (June 2015) has opened up its call for papers, now through Jan 19th, 2015. (via)
- A conversation about UTF-8, Unicode, and file systems.
- A conversation about random vs. phrase passwords.
- New Directions in Operating Systems conference notes. Lots of BSD stuff in there. (via)
- nih-0.13.0 is out for pkgsrc.
- BSD presentations (including DragonFly) at the X Developers Conference. I mentioned the event itself before, but that link wasn’t open to non-subscribers until later, as pointed out to me.
- Coreboot on the BSDs.
- More talk about embedded OpenBSD on cheap machines, including thin client machines repurposed into routers.
- Noticed in that previous link: <$100 Ubuquiti EdgeRouter-Lites can run OpenBSD? FreeBSD too, apparently.
- Is it time to give BSDs a try?
- Fixing PC-BSD upgrade issues.
Despite the US holiday, here’s a pile of BSD material.
There’s a few more days of freeze for the pkgsrc-2014Q3 release of pkgsrc. Normally I’d save this for the weekend In Other BSDs, but that’d be too late.
Low on the source links this week, but there’s plenty else.
Update: from talk@nycbug, George Rosamond gives a nice APU setup summary.
This has been a very hectic week for me, but I still have links for you.
Why is it so warm out? I want autumn to start.
I went from 1 link to lots all in one night.
Another long list. These are making my Friday nights take some extra effort.
I was thinking this was going to be a short week, but nope.
Finally, a much more eventful week. I already noted LibreSSL’s release.
Another ‘quiet’ week – lots of commit activity in the other BSDs, but not a lot to point at directly.
I have a backlog from stuff I missed last week while traveling, so we all benefit!
Some leftovers from last week since I’m catching up, so get ready to read.
Updated late this week because of circumstances.
I’ve got “coverage” of most every BSD this week.
Remember: If you have a particular port that’s not building in DragonFly, there may be a patch in pkgsrc that could be brought over, as John Marino points out.
I have a list of commits I’ve saved between the various BSDs of licenses getting corrected to the 2-clause BSD license; that would definitely be a good cross-BSD project to sync.
Another week with lots of links.
Links everywhere this week!
Read the first item, if nothing else.
Lots of links, yet again.
As you read this, I’m at NYCBSDCon – or at least should be.
- FOSDEM 2014 videos are up. The second item listed is about the new version of ports, which includes dports. (via)
- Crochet-FreeBSD, a system for building bootable FreeBSD images for a variety of platforms including x86, ARM, and VM. (via Markus Pfieffer on IRC, indirectly)
- Effective Spam and Malware Countermeasures. Seen previously at BSDCan. ‘Greytrapping’, mentioned in the article, is new to me.
- Email delivery headaches. Mailing many people is somehow almost always a low-level irritation.
- DiscoverBSD’s 2014/02/03 roundup.
- Another n2k14 hackathon report. DragonFly uses that DHCP client he’s talking about.
- PC-BSD on eWeek.
- bsd-cloudinit – FreeBSD on OpenStack. (via)
- OpenBSD gained some VAX hardware. The only VAX hardware I ever saw was 6 feet tall; I can’t imagine these are easy to ship.
- OpenBSD updated to ldns 1.6.17.
- Seen via a pkgsrc list: Berlios.de is closing down its hosting, so this may affect you if you usually grab your pkgsrc packages from there.
- The proper way to break the FreeBSD ABI.
- Robert Watson’s privilege ideas.
- How to switch between mfi(4) and mrsas(4) on FreeBSD. mrsas(4) sounds like MRSA to me, which is a bit more worrisome
- FreeBSD supports MegaRAID Fury cards.
- The plan for ATF removal in NetBSD.
- DragonFly takes the FreeBSD patch(1) updates, and that’s fine, because FreeBSD made those changes to an import of DragonFly’s patch(1). Hooray for cross-pollination!
For once, I got this mostly done before late Friday night!
Running late putting this together… Back to bullets!
Odds and ends for the quieter holidays.
I had a sometimes-great, sometimes-difficult trip to New York City over the past few days, and while I was there, I met the ball of energy that is George Rosamond of NYCBUG (which is having a huge party right now.) He and I talked for a bit about various aspects of the BSD ecosystem, and one thing he noted was that people aren’t generally aware of all the licenses in use for the different software packages on the system, or even the individual licenses in the system files.
There is an ACCEPTABLE_LICENSES setting in pkgsrc, where software licensed under terms not in that list won’t install. That’s useful, but frustrating, because it keeps people from getting what they asked for – a software install. Something that would be useful – and it could be cross-BSD very easily – would be a license audit summary.
There’s meta-data on every package in FreeBSD’s ports and DragonFly’s dports and pkgsrc and OpenBSD’s port system. Why not say ‘pkg licenses’ in the same way you can say ‘pkg info’, and get a summary of the licenses you have installed in the system? (or pkg_licenses, etc. You get the idea) This wouldn’t prevent people from installing software, but it would give a very quick view of what you were using.
> pkg licenses
Software package License
foo-2.2.26 Apache license
It could be extended to the base system, but I’d like to see this in all the packaging systems as a common idea, in the same way that ‘info’ in a packaging command always shows what’s installed.
Not as much pulled directly from the source lists this time, which is good.
Not sure why, but there wasn’t a lot of things this week to pick out.
There’s a surprisingly large list this week.
- FreeBSD has updated netmap.
- FreeBSD supports VT-d DMAR hardware. Not totally sure what that is.
- FreeBSD supports the RealTek RTL8168G, RTL8168GU, RTL8411B, and RTL8168EP.
- FreeBSD updated byacc to version 20130925.
- FreeBSD has binary packages again.
- Managed Services using FreeBSD at NYI, a whitepaper.
- NetBSD has imported OpenBSD’s support for ASIX AX88178a and AX88179 USB network interfaces, in the axen(4) driver.
- NetBSD supports the Broadcom BCM56340 iProc based switch.
- OpenBSD supports unattended installation. See Also on Undeadly.
- OpenBSD has softraid booting documentation. Someone will find this useful, I’m sure.
- OpenBSD 5.4 is released.
- Inspecting Packets with OpenBSD and pf, the presentation from vBSDCon.
- Lua in pkgsrc has been modified.
- Ocaml in pkgsrc has been updated to 4.0.1.
- The BSD Router Project has hit 1.5. (via)
- PC-BSD 10 alpha images are available for testing.
- PC-BSD is doing weekly updates, an idea I support, unsurprisingly.
- No BSD systems in Google Code-In this year, darnit.
Matthew Dillon wrote a roundup post summarizing all the changes he’s made to DragonFly to improve SMP performance in the last few weeks. He’s removed almost all contention from DragonFly. This means better performance, scaling upward depending on the number of processors.
‘monster’, the system that builds all 20,000 items in dports, can complete the run in 15 hours. Compare this to the 2 weeks it used to take me to build the 12,000 packages in pkgsrc. This is admittedly on different hardware and different packaging systems, but it gives a sense of the scale of the improvement.
Once again, doing this at the last minute:
As a followup to news that the git feed of pkgsrc through dragonflybsd.org is not being updated, Max Herrgard wrote out how to fetch pkgsrc via CVS, or tarball, or another git feed. CVS is still the ‘official’ way.
The pkgsrc repository in git for DragonFly is currently frozen. This is because many people have switched over to dports, and also because it’s a lot of work to keep it functional. If you do want to pull newer pkgsrc material, use cvs and grab it from a NetBSD server.
As the message notes, don’t go switching to DragonFly-current right now, cause there’s a lot of new material in there and it may not be quite safe. (There’s an ABI change that will require all new builds of your ports, for instance.)
Less straight source links this week.
Related to DragonFly: Patrick Welche updated glib2 in pkgsrc, and is interested in hearing how it works for DragonFly users. If you have pkgsrc on your system and it’s not a quarterly release, try building t.
DragonFly has generally shifted over to dports for 3rd-party software management, away from pkgsrc. Because of that, I haven’t been building binary packages of the quarterly pkgsrc releases. Pierre Abbat asked why on users@, and here’s my explanation of the change.
Barely getting this done in time for Saturday…
I need to update this post during the week as I see stuff, or else I spend an hour rushing to get it all together before Satuday. I need to start watching PC-BSD src changes, too.
I hope I’m catching the interesting stuff; I’m only reading the src changes.
How many tags can I fit on this post? I think I’ll aim for Saturday for these BSD catchup posts. In theory, I can prep this and the Sunday Lazy Reading posts ahead of time, since they tend to be all-week items, and have the whole weekend covered.
Here’s what jumped out at me from reading source change mailing lists:
I’m going to have to set a specific day of the week aside for these.
The pkgsrc-2013Q2 branch has been out for some days, but the official release announcement has now been published, with details on the number of ports. You should be able to pull it down from dragonflybsd.org via git, by the way.
The official announcement has gone out. You should be able to pull pkgsrc-2013Q2 via git from dragonflybsd.org within the next 24 hours.
It looks like OpenJDK7 works in pkgsrc for DragonFly, thanks to Ryo ONODERA, and I think it’s working in dports too.
Whoops, I missed this when it happened, but: the freeze for pkgsrc-2013Q2 has started. That new quarterly release is anticipated for the end of the month.
The next pkgsrc freeze is planned for June 17th, 9 days from now. So, get your changes in now, for 2013Q2…
Johnathan Perkin has a nice tutorial up about creating pkgsrc packages. It’s done on SmartOS, but I imagine it’ll generally apply to anything pkgsrc supports.
NetBSD uses pkgsrc but ships a version of xorg with NetBSD. This is effectively producing the same code twice. There’s a long discussion on tech-pkg@ (first article linked; keep reading) about moving to the pkgsrc version of xorg for NetBSD, which seems like a good idea for focusing effort, as far as I can tell. The thread goes on quite a way.
I finally got DragonFly 3.4.2 img/iso files uploaded, so they are available now or at least soon at your local mirror. These are built using pkgsrc, so if you want dports, go for a snapshot image.
There’s more download statistics on dports and pkgsrc packages, from Francois Tigeot. There’s a heck of a lot of dports activity, though there’s probably much more pkgsrc building from source than this would report on. So, not necessarily representative of actual numbers, but an interesting ratio none the less.
Matthew Dillon and Sascha Wildner have converted snapshot/release building over to use dports instead of pkgsrc. If you want to try one of those snapshots, look in the snapshots directory… Oh, and here’s the mention of this on kernel@.
In the week after DragonFly 3.4 was released, Francois Tigeot was tracking downloads for each type of packaging system. It looks like dports downloads far outnumber pkgsrc. I think there’s reasons it appears different in uptake, but it’s still neat to see people trying the new system.
Ansible seems to be a configuration management system that’s lighter than puppet or salt. I had a student talking about it in my class tonight. BSD users Hubert Feyrer and Michael W. Lucas have both posted about it recently. Anyone want to repeat their experiences?
If you were perhaps thinking of setting up transmission-daemon, a BitTorrent server, this post on email@example.com will help you out.
It’s been 2 years since the pkgsrc packages for DragonFly 2.12/2.13 were getting updated, so I am going to remove them. If you’re running DragonFly 2.12, you’ll want to either build from source or upgrade DragonFly.
Eric Radman sent along a plug for a utility he is working on called entr(1). The desciption is “Run arbitrary commands when files change.” The site for it has several nifty examples – run make when *.c files change, or convert Markdown files to HTML as soon as they are modified. The really nice thing about it is that it’s perfectly BSD-friendly, and uses kqueue, but will also work on Linux. This beats the “This runs on the one flavor of Linux I use, in one particular shell!” approach I’ve seen from some other developers. See the reddit discussion of it for comparisons to inotify.
No, it’s not in pkgsrc/ports yet.
Update: And thanks to Thomas Klausner, it’s in pkgsrc as sysutils/entr, and in ports as sysutils/entr thanks to Eitan Adler. You have no reason not to try it now.
It looks like Postgres versions less than 9.0 are going to be removed from pkgsrc soon. Be ready to update, if you are running one of those extremely older editions.
The DragonFly Git repository of pkgsrc now has the 2013Q1 branch. You can switch to it by editing your /usr/Makefile (look for existing references to either pkgsrc master or pkgsrc-2012Q3) and using the normal commands.
The 2013Q1 branch of pkgsrc has been announced. Along with the normal quarterly material, there’s several notes: preliminary Cygwin support is present, ruby 1.8 will be retired in favor of 1.9 after this release, and the pkgsrc.org web page now has a very nice new look and logo.
I plan to branch DragonFly 3.4 very soon, and that version will have 2013Q1 as default.
Update: The 2013Q1 branch should be available by tomorrow on DragonFly’s git; the repository needs to update and convert from NetBSD’s CVS and that takes a little time. I’ll post when it’s ready.
I hope you like reading; there’s some very meaty links this week. Go get a cup of tea and settle in. You drink tea, don’t you? You ought to.
- Reading about KDE’s repository near-meltdown makes me think we need more checks for DragonFly. We have the advantage of Hammer, of course, which would help in the same way that the linked article names ZFS as a ‘fix’. (via multiple places)
- We know that Apple will reject apps it disagrees with. Google also will do so. Has there ever been a program rejected from pkgsrc or (FreeBSD/OpenBSD) ports on content grounds? Not that I know of – anyone remember differently? I’d argue that’s a favorable point for the BSD packaging systems, though it may just be that no application has tested those boundaries yet.
- Portscanning all IPv4 addresses on the planet. Possibly the largest distributed effort ever? The detail in the maps and returned services is especially interesting. (via)
- Scale Fail, a Youtube video of a 2011 talk about screwing up your services. Mostly about the humor, but the underlying points are valid. (via #dragonflybsd IRC)
- There’s still improvement possible to fsck, apparently based on this. That’s UFS2 fsck.
- What is your most productive shortcut with Vim? A very thorough explanation of verbs, marks, and registers. Holy cow, I wish I had known about ‘: … v’ before. It’s long, but worth it. (via)
- Matthew Garret’s description of Secure Boot vs. Restricted Boot with UEFI, (via a coworker who went to Libreplanet 2013). I’m still not sure what DragonFly will need to do about this.
- I missed mentioning this earlier: 20 years of NetBSD. We’re coming up on 10 soon.
- Dragonfly drones. Unrelated except for name.
- That guy who starts to froth madly every time BSD is mentioned on Phoronix is still there (see comments).
- Mainframe computer supercut. (via)
Your unrelated comics link of the week: Tom Spurgeon of the Comics Reporter asked people for their lists of webcomics that could go in a ‘Hall of Fame’. The resulting list is a lot of really, really good material. Go use up a few hours reading.
I saw this Hacker News post and figured I should emphasize: pkgsrc is still going to be available in the 3.4 release of DragonFly; we’re not suddenly switching to dports. I don’t want anyone to think they’re going to have to rip out all their packages and go to a new, untried system, all at once.
Right now, if you install PHP, or something dependent on PHP, from pkgsrc, you get PHP 5.3. The default for pkgsrc will move to 5.4, though I assume that’s going to be after the pkgsrc-2013Q1 release scheduled for the end of this month. I don’t know the upgrade path, but it sounds like 5.3 is on the way to retirement, in any case.
The freeze for pkgsrc-2013Q1 has started; expect the next release at the end of the month. (Ignore the subject line).
The freeze for the next quarterly release of pkgsrc – 2013Q1 – has been announced by Thomas Klausner. March 17th to start, March 31st to end.
The 2013 version of pkgsrcCon is happening in a few weeks in Berlin, Germany. As announced, the presentation list is up. If you can’t make it to Berlin, there will potentially be video recordings of the event.
Cygwin is a ‘supported platform’ in pkgsrc now. This means your Microsoft Windows machine can now build packages out of pkgsrc. I have no idea how many packages actually succeed, but it’s interesting to see the same tools there as on other platforms.
As the title says, if you install MySQL from pkgsrc-current, you’ll now get version 5.5.
There’s two changes in pkgsrc recently that might affect you: graphics/png was updated, so many dependent packages will require recompilation. Also, editors/emacs was moved to a general package instead of being specifically named by version, so now you can install ‘emacs’ instead of ‘emacs24′ or whichever version.
This week I will both post this on the correct day AND get the date in the title correct.
- An oldie but goodie. ENHANCE. This will make anyone who has done photo/video editing twitch. Check the author’s Tumblr for more supercuts. (indirectly via)
- Many people complain about regular expressions (and more recently), but they are an insanely powerful tool if you know them well. If you do, figure out this crossword. (PDF) (via)
- Followup on the first two links in that last item: xkcd drives a lot of traffic!
- If you are on Windows, you probably use PuTTY for ssh. It saves everything in the registry, which can occasionally mean losing all your configuration. There’s manual ways to save it, but there’s also PuTTYtray. (I’ve used portaPuTTY in the past, but it seems to be missing/no longer updated.)
- Actually, holy crap there’s a lot of variations/addons for PuTTY.
- That makes sense given how many terminal emulators there are, really.
- Why piping something off the Internet right to a shell isn’t a good idea. (via)
- Remember when the computer section in bookstores had books that involved programming? (unfair, I know.)
- “Don’t Be A Stranger“, musing on how there isn’t enough meeting strangers through the Internet any more. Here’s the odd thought I had while reading that article: I couldn’t pick most of the other DragonFly developers out of a lineup, but I’ve been working and talking with some of them for a decade.
- You could build Photoshop version 1 yourself – just substitute the original Mac libraries.
- Related: Photoshop is a city for everyone.
- Some of the oldest color film footage. Not the oldest,but possibly some of the earliest commercial film. Of course, the first thing filmed are young, attractive women. This is a re-occurring theme.
- Hey, a comprehensive year-end BSD roundup.
Your unrelated tea link of the week: Epic Tea House Server. Interesting just because of what he does and because I’ve never encountered tea from a samovar, though I’ve read of it. (via)
Wait, this is better! That previous link led to this film from an English chemistry professor about tea chemistry. At first I was just entertained by his hair and his accent, but when he put tea in a NMR spectrometer, I decided this was the best tea thing ever. Even better than Elemental!
Pierre Abbat noticed that when using pkg_rolling-replace, his Python packages would fail to be built/replaced. This is because pkgsrc puts the version number into the name of the package, and he was moving from Python 2.6 to 2.7. OBATA Akio and Greg Troxel had suggestions/explanations.
It was planned some time ago, but versions of Samba older than 3.5 are now out of pkgsrc, and version 3.5 will hopefully be replaced by 4.0 soon. Ruby 3.0 and 3.1 will also be going soon.
If you have git installed, and you are trying to upgrade it, you may have problems. The scmgit-docs package dependency requires some DocBook files that aren’t always accessible. If you do run into this problem, there’s 3 separate options: