Category: pkgsrc

Upgrading to pkgsrc-2012Q1

Here’s a post by yours truly, on how to move to pkgsrc-2012Q1 though building from source.  This is for anyone sick of waiting for me to finish the binary build of pkgsrc.

Posted by     Categories: DragonFly, Goings-on, pkgsrc     0 Comments

Packages that will go, and packages that might go

There’s a few pkgsrc packages that might be going the way of the dodo, soon.  There’s a few more that need love, so speak up if you use them.  Maybe you can be the Somebody™ that fixes them?

Posted by     Categories: Goings-on, pkgsrc     1 Comment

Where are the pkgsrc-2012Q1 binary packages for DragonFly?

I’m still working on building them.  I kept getting panics, which seem to be fixed by this commit, so I should have something soon.  Sorry!

Posted by     Categories: DragonFly, Goings-on, pkgsrc     0 Comments

OpenJDK7 building

Based on a recent post from Chris Turner to the mailing list, here’s a bug report that should get you to a working lang/OpenJDK7 pkgsrc package.

pkginteractive: graphical pkgin

Julian Fagir has put together a graphical – meaning it works under curses in a terminal, or under X – interface to pkgin, the binary package manager.  Can someone try it and describe how well it works?

Posted by     Categories: Goings-on, pkgsrc     0 Comments

Some more pkgsrc expunging

There’s several packages that will be removed from pkgsrc after the 2012Q2 branch, since they haven’t worked in a long time.  Also, Python 2.4 has been removed from pkgsrc-current and 2.5 will go the same way before the end of the year.

Posted by     Categories: Goings-on, pkgsrc     0 Comments

pkgsrc-2012Q1 is branched

The next quarterly release of pkgsrc, pkgsrc-2012Q1, has been branched.  I’ll start building binary packages momentarily.

The branch should show up in DragonFly git later today.  Once available, you can change any references to ‘pkgsrc-2011Q4’ in /usr/Makefile to ‘pkgsrc-2012Q1’, and then to switch to it:

  1. cd /usr/pkgsrc
  2. git branch pkgsrc-2012Q1 origin/pkgsrc-2012Q1
  3. git checkout pkgsrc-2012Q1
  4. git pull

At that point, you can start building and installing newer applications.  For more details on that, check the pkgsrc guide on the DragonFly website.

Note that you don’t have to do that; you can stick with the 2011Q4 (or earlier) packages you have installed now, if you don’t want to deal with software changes right now, or if you want to wait for the binary packages to become available.  Upgrades/security fixes only happen for the latest quarterly release, though.

Note: don’t assume I tested this before advising you to do it, or anything like that.  I mean, come on.

Posted by     Categories: Goings-on, pkgsrc     2 Comments

Packages that might go away, or not?

There’s been some discussion of packages that have been broken for a long time in pkgsrc, over on the mailing list.  It’s interesting to see just what breaks these packages, though it still seems up in the air whether any will be removed or not.  (Follow the thread if you have time.)  I don’t think the discussion has ended yet.

Posted by     Categories: Goings-on, pkgsrc     0 Comments

Plans for pkgsrc

I just removed old pkgsrc binary packages for DragonFly 2.6/2.7 from avalon, so if somehow you are running a version of DragonFly that old, and still using binary packages, you’ll want to upgrade.  I’m pretty confident that describes nobody.

Also, I have plans for coordinating the next pkgsrc release of 2012Q1, due April 6th, with the probably next minor upgrade of DragonFly, 3.0.3.  I wrote out my plans already, so go read.  (plus followup)

Posted by     Categories: DragonFly, Goings-on, pkgsrc     0 Comments

Another pkgsrc bulk build report

This report from yours truly is using pkgsrc-current, so it reflects some of what will show up in pkgsrc-2012Q1.  John Marino has already fixed some of the “top breakage” items, so the numbers should be even better for the next one…

Posted by     Categories: DragonFly, pkgsrc     0 Comments

Freeze for pkgsrc-2012Q1 has started

It runs from now to April 6th, so nothing but bug fixes in pkgsrc until then.  If you have any package fixes you needed, now’s the time to ask someone.

Posted by     Categories: Goings-on, pkgsrc     0 Comments

Are you using old packages?

We have pkgsrc binaries still around for DragonFly 2.6/2.7.  As I posted, I’d like to get rid of them.  Would that inconvenience anyone?

We don’t have a set expiration policy.  We probably should.

Posted by     Categories: DragonFly, pkgsrc     0 Comments

Things for, and not for, the next pkgsrc branch

That’s pkgsrc-2012Q1 I’m talking about.  It appears KDE will jump from 4.5 (what’s there now) to 4.8, and Zope/Plone will be removed.  This will make you happy or sad depending on whether you have these things installed.

Posted by     Categories: Goings-on, pkgsrc     0 Comments

Freeze is coming to pkgsrc

I can only use this joke for as long as the series is running.The freeze for the next version of pkgsrc, 2012Q1, will start March 22nd and end with the quarterly release being released on April 6th.

(I hope someone gets the joke.)

Posted by     Categories: Goings-on, pkgsrc     0 Comments

Build report for pkgsrc

For the curious, I recently sent a bulk build report for pkgsrc-2011Q4 to the lists.  Other than ruby-193 (which is fixed in pkgsrc HEAD thanks to John Marino), we’re looking pretty good!  I’m curious if KDE or Gnome could actually get installed via binary; that’s sort of an ultimate goal due to the number of packages involved.

Speaking of Ruby, the default in pkgsrc may change soon, along with some of the involved Rails packages.

Posted by     Categories: DragonFly, Goings-on, pkgsrc     4 Comments

Older Python not dead yet

A few days ago, I posted about Python 2.4 and Python 2.5 leaving pkgsrc – it looks like it’ll be a little bit longer, at least for the 2.5 version.  This means the Zope packages will be gone too, since they depend on Python 2.4.  This won’t affect you if you aren’t using these packages, of course.

Posted by     Categories: Goings-on, pkgsrc     0 Comments

Python changes in pkgsrc

The default version of Python in pkgsrc is going to become 2.7.  This will mean the 2012Q1 release will use that version by default.  Older versions, meaning Python 2.4 and 2.5, may be going away.  At least, that’s how the linked thread started but I’m not totally sure about it as I read farther through.

Posted by     Categories: Goings-on, pkgsrc     1 Comment

Things I’ve never seen before, in pkgsrc

I was reading an article about how Tumblr scaled to handle the huge amount of data it’s regularly pushing out.  Apparently, it started life as a traditional LAMP stack, but they’ve since moved on – to software packages I have not yet needed to ever use.  Being open source software, it all has crazy names.  Some of these packages are perfectly familiar to me now, but others are completely new.

Anyway, for fun, I decided to see how many of these sometimes new-to-me packages were present in pkgsrc.  I’ll reproduce a paragraph from the story that lists the software they use, and link each one that I found in pkgsrc.

That’s actually more than I thought I’d find, though I can’t articulate why.  Anyway, if any of the names are unfamiliar to you, now is the time to follow up.   Redis, for example, looks more interesting to me at a casual glance than the normal NoSQL models I’ve heard about.

Posted by     Categories: Goings-on, pkgsrc     2 Comments

Some BSD Multimedia

Here’s several things to look at:

Michael Lucas’s “BSD Needs Books” talk from NYCBSDCon 2010, on Youtube.  I’ve talked about it before because I saw it in person; it’s a good talk.  Ironically, he talks about getting a publisher interested in your book, and he just self-published.

Hubert Feyrer linked to the slides of two pkgsrc talks at FOSDEM; one about bringing pkgsrc to MirBSD, and one about pkgin, which is included in DragonFly.

Posted by     Categories: BSD, Conventions, pkgsrc     0 Comments

NetBSD Hackathon, February 10-12

There’s a NetBSD Hackathon going on February 10th through 12th, mostly online.  I mention this because it may have some effect on pkgsrc, used by both NetBSD and DragonFly.  Hackathons for pkgsrc usually happen separately, but no harm in keeping an eye out for any positive benefits.

Posted by     Categories: DragonFly, NetBSD, pkgsrc     1 Comment

Updating Samba to 3.6

I’m posting this because it will save someone (possibly me) an hour of aggravation someday.  If you are updating Samba from version 3.0 or 3.3 to a later version, it’ll take your existing config but possibly silently break on user authentication.

Posted by     Categories: pkgsrc, Someday you will need this     0 Comments

Up-to-date packages and pkgsrc

Ulrich Habel wants to update some of the Perl 5 modules in pkgsrc.  He published a request for comments, describing what he plans to do for changing some dependencies.  He does note that Perl 5 in pkgsrc is at 5.14.2, which is very recent.

I was talking to a relative today who works at a large financial company, which is standardizing on Red Hat Enterprise.  I find it strange that Red Hat, which has a lot of money behind it, still ships a years-old and arguably broken version of perl.   By using pkgsrc, you’re getting more up-to-date software than people that actually shell out money for the privilege of compiling software.

Posted by     Categories: Goings-on, pkgsrc     1 Comment

If you liked KDE3, you’ll like this

If you liked KDE3, you may like Trinity.  Matthias Drochner would like you to help get it in pkgsrc.

Posted by     Categories: DragonFly, pkgsrc     2 Comments

How long until DragonFly 3.0?

The answer is “not very”.  As I wrote in a post to kernel@, DragonFly 3.0 will be tagged soon, and released when there’s pkgsrc-2011Q4 packages to go with it.  Probably a week if everything goes to plan.

Posted by     Categories: DragonFly, Heads Up!, pkgsrc     2 Comments

Gnat-aux is the way to go

John Marino has pointed out, with a number of examples, that gnat-aux is the best pkgsrc-based compiler for DragonFly right now, in terms of compatibility and support.  It’s certainly good news if you are an Ada programmer.  He lists some interesting numbers to demonstrate this superiority, though you can’t buildworld with it yet.  (gcc 4.4, on DragonFly as part of the system, will do this normally.)

Posted by     Categories: DragonFly, Goings-on, pkgsrc     0 Comments

How to get DNSSEC going

I just mentioned DNSSEC in last week’s Lazy Reading, and here’s a “How to get DNSSEC with BIND 9.8.1 working” article from Michael Lucas.  It’s pretty simple…  Conveniently, BIND 9.8.1 is available in pkgsrc as net/bind98.

A pile of sh and pam fixes

Peter Avalos added an avalanche of updates for PAM and sh, so I’ll link to a few of themThe changes are mostly sourced from FreeBSD.  The PAM changes remove pam_krb5 and pam_ksu, for which there’s an alternative.

Licensing for pkgsrc

I’m linking to this small discussion about licensing and its documentation in pkgsrc, just because these paragraphs, out of context, are good for any pkgsrc user to know.

Posted by     Categories: Goings-on, pkgsrc     0 Comments

Lazy Reading for 2011/12/18

The links are sheer entertainment this week.  No strong options or anything, not even about that U.S. legislative mess called SOPA.

Your unrelated comic link of the week: Basic Instructions.  Well, not totally unrelated, since BSD author Michael Lucas’s tweet about it reminded me.  I’ve got the first book; I need to get the second and third.

Posted by     Categories: BSD, Lazy Reading, pkgsrc, roguelike     0 Comments

pkgsrc-2011Q4 freeze started

The freeze for pkgsrc-2011Q4 has started.  No updates to pkgsrc, other than for security, for the next two weeks.

Posted by     Categories: Goings-on, pkgsrc     0 Comments

pkgsrc-2011Q4 freeze soon

The last quarterly release of pkgsrc for the year is scheduled for the end of this month.  This means the freeze, where only bugfixes are applies, will be starting on the 17th.

Posted by     Categories: Goings-on, pkgsrc     0 Comments

Two pkgsrc work directory tips

Two tips for working with pkgsrc, derived in part from this mailing list post on users@ (follow the thread) and from my own experience.  If you put WRKOBJDIR=/usr/obj/pkgsrc into /usr/pkg/etc/mk.conf :

  1. You can clean up any leftover package building files by deleting the files in that directory and leave your pkgsrc files untouched.
  2. You can have a read-only /usr/pkgsrc, which means it can be shared over NFS (or SMB?) between multiple machines, DragonFly or otherwise.
Posted by     Categories: DragonFly, Goings-on, pkgsrc     0 Comments

fastbulk now added

Some time ago, Matthew Dillon worked on a bulk build system that built as much of pkgsrc in parallel as possible.  It’s in the tree now as ‘fastbulk‘, for anyone wanting to try it out.  I used it a bit; I didn’t measure the degree of speed increase, but was able to get about 70% of the packages built.

Posted by     Categories: Committed Code, DragonFly, pkgsrc     2 Comments

New rpkgmanager page

There’s a new page up on the DragonFly website, about using rpkgmanager to manage your pkgsrc-installed packages.

Posted by     Categories: DragonFly, Goings-on, pkgsrc     0 Comments

DESTDIR: 31 left

Almost all the packages in pkgsrc support non-root installation now…  except these last 31.  I recall something about their removal by the next quarterly release if they still don’t work, or maybe just after.  Jump in if one of these packages is useful to you.

Posted by     Categories: Goings-on, pkgsrc     0 Comments

Structure changes mean recompilation

This recent structure change (are there others like this?  Maybe?) means that existing binaries may need to be recompiled for anyone tracking DragonFly master.  This probably means that an upgrade from 2.10 to 2.12 will require rebuilds of all binary pkgsrc packages.

Posted by     Categories: DragonFly, Goings-on, pkgsrc     3 Comments

Some pkgsrc bulk build comparisons

Here’s some recent x86_64 bulk builds: one on DragonFly 2.11, one on NetBSd 5.0.2, and one on Linux  Some data of note: DragonFly is within 8%-ish total packages built compared to NetBSD, which could be considered the baseline.  Linux, the more common platform for most of the software built, is another step less.  I don’t know if there’s any dramatic conclusion to get from this other than, “Hey, a lot of packages build on DragonFly!”

Posted by     Categories: DragonFly, NetBSD, pkgsrc     0 Comments

Lazy Reading for 2011/10/23

Not a lot of links this week, for some reason.

Your unrelated comics link for the week: Oglaf.  This week’s OK, but it’s frequently NSFW, and frequently hilarious.

Posted by     Categories: DragonFly, Lazy Reading, pkgsrc     0 Comments

Fixes in pkgsrc

I know this happens normally, but I like to point out that it exists.  From the recent pkgsrc-2011Q3 bulk build reports I posted, Samuel Greear found two problems to fix, and thanks to him and OBATA Akio, net/net-snmp and devel/poco are fixed for DragonFly.

Posted by     Categories: DragonFly, pkgsrc     0 Comments

Bulk build results for 2011Q3

I have some pkgsrc-2011Q3 builds done, for x86_64 and i386.  I performed them on DragonFly 2.11, but they should work fine for 2.12/2.13.  They’re uploading to the pkgsrc-2011Q3 folder on mirror-master, so you’ll need to set PKG_PATH correctly to use them via pkg_radd.


The x86_64 package upload is done, and I anticipate the i386 one will be done within the next 24 hours.

Posted by     Categories: DragonFly, pkgsrc     0 Comments

pkgin 0.5 changes

Among other changes to pkgin 0.5 (available in pkgsrc-wip but not pkgsrc-2011Q3), it now notices if you need a newer pkg_install because you’ve shifted to a more recent quarterly release of pkgsrc, and grabs the appropriate binary package to fix that.  Thanks, iMil!

Posted by     Categories: Goings-on, pkgsrc     0 Comments

pkgsrc-2011Q3 is released

The latest quarterly release of pkgsrc is out.  You can download it via CVS, or update /usr/Makefile to pull down the correct branch.  I’ll be building binaries as soon as I can.  I like the release announcement style.

Posted by     Categories: pkgsrc     0 Comments

Another pkgsrc-current build complete

I finished a build of pkgsrc-current on x86_64, with a report on what built.  I’ve kicked off a new build, and I expect at least 100 more packages to build thanks to John Marino’s work on pkgsrc and DragonFly.

Posted by     Categories: DragonFly, Goings-on, pkgsrc     0 Comments

Pkgsrc freeze for 2011Q3 is extended

The freeze for the next quarterly release of pkgsrc has been extended another week, to October 2nd.  This will push the DragonFly 2.12 release out a ways, too.

Posted by     Categories: Goings-on, pkgsrc     0 Comments

The usual Postgres shift

As is common for the combination of new Postgres releases and new pkgsrc quarterly releases, Postgres 8.3 is going to be missing from pkgsrc-2011Q3.  The default version of Postgres installed by pkgsrc will become 9.0 after that quarterly release.  (9.1 is already present in pkgsrc.)  This is all planned by Joerg Sonnenberger.

Posted by     Categories: Goings-on, pkgsrc     0 Comments

Freeze for pkgsrc has started

As predicted and now announced, pkgsrc is now frozen for the next week.  If everything goes well, we’ll have pkgsrc-2011Q3 next week.

Posted by     Categories: Goings-on, pkgsrc     0 Comments

DragonFly releases and pkgsrc releases

I proposed some changes to the way DragonFly does releases, and how we handle pkgsrc binary builds.  The thread on kernel@ is a bit long, so just read my summation.  My idea for a longer release cycle didn’t really fly, but pkgsrc binaries will be built on a rolling basis, I think.

Posted by     Categories: DragonFly, Goings-on, pkgsrc     0 Comments

PHP 5.3 update on the way

For reasons unknown to me, there’s enough functional change between PHP 5.2 and PHP 5.3 that it affected a lot of PHP-based programs.  For that reason, PHP 5 in pkgsrc defaults to the 5.2 version.  However, it’s going to be 5.3 for the next stable quarterly release of pkgsrc.  In theory, all PHP5-dependent programs are ready to handle that now.  Note that PHP 5.3 is already in pkgsrc; it just wasn’t the default.  If you were using the php53 package, it may require some manual fiddling at your next upgrade of pkgsrc packages.

Posted by     Categories: Goings-on, pkgsrc     0 Comments

Debugging with pkgsrc

At some point, you may want to generate binary programs that are unstripped of debugging information.  You may want to generate them with pkgsrc.  Here’s a little note on what options will make that happen.

Pkgsrc in freeze soon for 2011Q3

The ‘freeze’ period (when bugfixes are the only addition) for pkgsrc will start on September 18th, with the next quarterly release of pkgsrc, 2011Q3, scheduled for the 25th.  Think of it as an early Christmas present.

Posted by     Categories: Goings-on, pkgsrc     0 Comments

New commit bit, but not for DragonFly

John Marino, who already has commit access for DragonFly, now also has commit access for pkgsrc.  What does this mean?  It means if you have a pkgsrc problem, submit it through  NetBSD’s Problem Report system as normal, and maybe let him know about it too.   He’s already made some DragonFly-specific fixes.

Posted by     Categories: DragonFly, Goings-on, pkgsrc     0 Comments

pkgin 0.5 on the way

The next release of pkgin, the binary package installer for pkgsrc, is imminent.  I link to the note about this because the new features list sounds good, including a significant speedup.

Posted by     Categories: DragonFly, Goings-on, pkgsrc     0 Comments

Lazy Reading for 2011/08/28

This week has taught me one thing for sure: Always make sure your backup generator is working.  And over-plan battery capacity.  That’s actually two things, but what the heck.  I’m tired, for reasons that can probably be inferred!  I’m not the only one suffering these problems, it seems.

  • There is a certain subset of readers here that will find this fascinating: a video of a game postmortem.  Specifically, Elite.  (via)  Needs Flash.
  • This is as good an article as any I’ve seen describing where the tablet computer market is going, at The Economist.
  • Remember RetroBSD, mentioned here previously?  Here’s some discussion of it.
  • EuroBSDCon’s 2011 conference is open for registration, but the early bird discount only lasts until the end of August, so jump on it soon if you’re thinking of going.  It’s the 10th anniversary of the event!
  • PHP 5.3 is coming to pkgsrc as default, soon?  The PHP 5.2 -> 5.3 transition seems to mess up a lot of code because of some changes in the way things are handled, or at least that’s my experience, so watch out.
  • Make sure you aren’t running mod_deflate on your Apache 2.x server.
  • Kristaps Dzonsons, the fellow behind mdocml (which is in DragonFly now and mentioned here before) is working on a mdoc manual.  It’s an actual book, with examples.  It’s titled “Practical UNIX Manuals: mdoc”, which sounds like part of a series, though I don’t know if there’s anything else.  I’d sure like it if there was.  (via Undeadly.)  Look very closely at the mdoc web page and you will see the markup, too.  Neat!
  • Breakout treated as a musical instrument, in 1983.  That’s too glib a summary of this explanation of an old book studying the game Breakout and playing it.  Really, read the article, and remember that the book described would just be lost in a sea of blog posts noise today.  (via)

Your unrelated comic link of the week: Wonderella.  This is the comic that ruined Batman for me.  I can’t unthink it.


Posted by     Categories: BSD, Conventions, Goings-on, OpenBSD, pkgsrc     0 Comments

DESTDIR almost done

There are only 45 packages out of over 10,000 in pkgsrc that do not support being installed by people who aren’t root, or in different locations.  Thomas Klausner has that list of 45 packages.  It’s very close to zero packages with this problem at this point, so if you want to make a big difference…

Posted by     Categories: Goings-on, pkgsrc     0 Comments

Mixing pkgsrc and alien packages

Anton Panev is working on a Google Summer of Code project for NetBSD, adding support in pkgsrc for RPM/Debian package formats.  He posted a status report recently; will this come to DragonFly via pkgsrc?  I don’t know!

pkgsrc: now as git

CVS has traditionally been used to distribute the files in pkgsrc, but there’s been a converted git version for DragonFly for a bit now.  It looks like there is now an official version (i.e. for everyone, maybe to replace CVS?) at Github.

Posted by     Categories: DragonFly, Goings-on, pkgsrc     0 Comments

Updating to pkgsrc-2011Q2

I put together a post on users@ about updating to pkgsrc-2011Q2.  I’ll just repeat it here after the break:


Posted by     Categories: DragonFly, Goings-on, pkgsrc     0 Comments

More clang and pkgsrc

I recently saw some terse notes on about compiling using clang for pkgsrc.  I haven’t tried this on DragonFly…

Posted by     Categories: Goings-on, pkgsrc     1 Comment

More Java on DragonFly

Francois Tigeot has fixed wip/jdk16 to build on DragonFly.  Note that this is in pkgsrc-wip, not ‘normal’ pkgsrc.  The secret is to build lang/kaffe to bootstrap it, which requires CCVER=gcc41 to be set.  Apparently kaffe will not build under gcc 4.4.

Why did he do it?  To run OpenGrok, of course.  He’s posted instructions on getting OpenGrok running on DragonFly.  Note the Java crashes he reports in DragonFly 2.11 may already have been fixed.

p.s. I hated “Stranger in a Strange Land”.

Posted by     Categories: DragonFly, Goings-on, pkgsrc     0 Comments

2011Q2 binary builds finishing up

The builds of pkgsrc-2011Q2 are finishing up, so we have/will have binaries to download, for those who don’t want to build from source.  The uploads should be complete by now for everything except maybe 2.11/x86_64.  You’ll have to change $PKG_PATH to point at the new directories for now, though.  There’s also some build reports to look at.

Posted by     Categories: DragonFly, pkgsrc     0 Comments

clang and pkgsrc bulk builds

I spied a bulk build of pkgsrc using clang.  It’s interesting to see the results…  It’s on NetBSD, but it should be possible to try the same thing with CCVER on DragonFly.  Any takers?

Posted by     Categories: DragonFly, Goings-on, NetBSD, pkgsrc     0 Comments

pkgsrc-2011Q2 is branched

The latest quarterly release of pkgsrc, 2011Q2, has been branched.  There’s no formal announcement yet to describe the highlights, but I’ll link it when it shows up.  I’ve already started building binary packages for DragonFly 2.10 and 2.11.

Posted by     Categories: DragonFly, Goings-on, pkgsrc     0 Comments

A change for committers, a change for pkgsrc

Two completely separate and unrelated changes:

First, Alex Hornung has added a check to look for certain lines in a commit message, and add a MFC reminder note to the commit message if they are found.  MFC, if you haven’t heard it, means ‘merge from current’, or moving a change from dragonfly-current to the last release version.

Second, with the next quarterly release of pkgsrc coming up, there’s some old packages that will get dropped.  Speak up if you need them to stick around.


Posted by     Categories: DragonFly, Goings-on, pkgsrc     0 Comments

Someone try the new bootstrap

Pkgsrc bmake bootstrap, that is.   There’s a new version of bmake, and it needs to be tested on every platform possible.

Posted by     Categories: DragonFly, Goings-on, pkgsrc     0 Comments

Freeze for pkgsrc-2011Q2 coming up

The pkgsrc ‘freeze’ in preparation for the pkgsrc-2011Q2 branch is coming up, starting this Sunday the 19th.  This means the quarterly release will be tagged in about 2 weeks, and I’ll probably have binary packages built for DragonFly about a week or so after that.

Posted by     Categories: DragonFly, Goings-on, pkgsrc     0 Comments

DESTDIR almost done

There’s still a few packages in pkgsrc that don’t support DESTDIR (e.g. being built by someone other than root).  If you want to help out, here’s a list of those 60 packages.

Posted by     Categories: pkgsrc     0 Comments

Trying out deduplication

I moved to DragonFly 2.10 over the past few days, and I tried out deduplication, to see what kind of results I would get.  The procedure is outlined below.  I’m using /home here as an example, just to reduce the amount of text pasted in.

/pfs/@@-1:00004     966000640 566434576 399566064    59%    /home

Move my various Hammer pseudo-file systems to version 5, which supports deduplication.

# hammer version-upgrade /home 5

Issue a deduplication simulate command, to see what it guesses will be the savings:

# hammer dedup-simulate /home
Dedup-simulate /home: objspace 8000000000000000:0000 7fffffffffffffff:ffff pfs_id 4
Dedup-simulate /home succeeded
Simulated dedup ratio = 1.22

That ratio turned out to be pretty accurate for the actual deduplication.  I didn’t time it, unfortunately.  I don’t know if the time taken is proportional to the amount of deduplication or the total volume of data, though I suspect the latter.

# hammer dedup /home
Dedup /home: objspace 8000000000000000:0000 7fffffffffffffff:ffff pfs_id 4
Dedup /home succeeded
Dedup ratio = 1.22
462 GB referenced
378 GB allocated
14 MB skipped
6869 CRC collisions
0 SHA collisions
0 bigblock underflows

The end result?

/pfs/@@-1:00004     966000640 505887504 460113136    52%    /home

That data space is shared across all file systems, and it’s a 1TB disk, so it’s 7%, or 70GB. I was hoping for more, but I don’t have any obviously duplicated data (no local mail store, no on-disk backups), so perhaps this is normal. 70GB that I didn’t have before is no bad thing, though.

Incidentally, I was able to upgrade my installed software from pkgsrc-2009Q4 to pkgsrc-2011Q1 entirely using pkg_radd -u <pkgname>.  Remarkably quick and painless, though pkgin may have been able to do it even faster since it would pull from the same place.

Posted by     Categories: DragonFly, Google Code-In, Hammer, pkgsrc     1 Comment

Another pkgsrc build

This new build is on x86_64, pkgsrc-2011Q1.  It’s already uploaded, if you want to update.  i386 coming soon.   Several packages freeze up during build, so it’s been turning into a manual process.

Posted by     Categories: DragonFly, pkgsrc     0 Comments

Other Summer of Code: pkgsrc

One of the Google Summer of Code projects that will be valuable for DragonFly even though it isn’t a DragonFly project: “Add other package formats to pkgsrc”, where pkgsrc can interpret rpm, dpkg, and FreeBSD Ports files.  Anyway, the project has a Sourceforge site.

Posted by     Categories: Goings-on, Google Summer of Code, pkgsrc     1 Comment

New pkgsrc bulk build results

I have them, for DragonFly 2.11/i386 and DragonFly 2.11/x86_64 (see pkgsrc-bulk), on pkgsrc-2011Q1.  I think I even uploaded them correctly this time.

Posted by     Categories: DragonFly, Goings-on, pkgsrc     0 Comments

Lazy Reading for 2011/05/15

This week: lots more reading!

  • Michael Lucas describes an extra layer of protection for when you can’t force public key usage on every SSH user.
  • Cool, but obscure Unix tools (via)  The screenshots are all from a Mac… How many of the 24 tools listed are in pkgsrc/pkgsrc-wip?   Almost all of them.  (tpp sounds entertaining.)
  • NYCBUG, in addition to having a really fun convention, has been regularly posting audio of the presentations they host.  The most recent is “William Baxter’s NYCBUG presentation on The Unix Method of Development Management”.   See the BSD Events tweet for the download.
  • What Ubuntu means.  (via)
  • Here’s a nice explanation of Intel’s new Tri-Gate design and with it, an incidental explanation of the processor market.
  • This ycombinator post about Hammer2 work has an in-depth comment from Venkatesh Srinivas about DragonFly’s network setup, memory allocator, and token use.  (Ignore the trolling in other comments.)
  • Michael Lucas’s next No Starch Press book is Absolute OpenBSD, second edition.
  • Pictures and video are starting to show up from the just-passed BSDCan 2011. (via this and also thesjg on EFNet #dragonflybsd)
  • My first experience of The Internet was very similar to this.  It should be bizarrely unfamiliar to anyone under 20 or so.  (via)  Get this: I typed ‘exit’ instead of just closing the browser window when I was done messing with it, because some habits cannot be broken.
Posted by     Categories: BSD, DragonFly, Lazy Reading, pkgsrc, UNIXish     0 Comments

Some new pkgsrc reports

I finished two builds of pkgsrc-2011Q1 on DragonFly; the reports are available.  The only real breakage is security/heimdal.   There’s a patch for that, though.

Posted by     Categories: DragonFly, pkgsrc     0 Comments

Chromium for DragonFly: please test

Rui-Xiang Guo is looking for testers for wip/chromium.  That’s the zippy Google browser.  He especially wants DragonFly users – this would be useful, especially since I think Firefox 4 does not build on DragonFly right now.

Posted by     Categories: DragonFly, Goings-on, pkgsrc     2 Comments

pkgsrc-2011Q1 build reports

We’ll have a full set of pkgsrc packages for the upcoming DragonFly 2.10 release, built from the most recent quarterly release of pkgsrc: 2011Q1.  For the curious, here’s the build reports for i386 and for x86_64 architectures.

Posted by     Categories: DragonFly, pkgsrc     0 Comments

Add package-clean to your list

The usual way for building pkgsrc packages from source is ‘bmake install clean’, to build and install the package, and then clean the work files from building it.  Since the recent change to DESTDIR, where a binary package is built before installation, you may want to add ‘package-clean’ to the list, so that the binary package is also removed after installation.

Posted by     Categories: DragonFly, pkgsrc     0 Comments

First pkgsrc-2011Q1 results for 2.10

No, 2.10 is not out.  I built packages for pkgsrc-2011Q1 on 2.9, and set it to think 2.10 so that the pkgsrc tools wouldn’t complain.  We’re close enough to release that this shouldn’t be a problem.  The packages are available for x86_64; i386 packages coming “soon”.   See my note to for details on accessing these packages.

Posted by     Categories: DragonFly, pkgsrc     0 Comments

Lazy Reading for 2011/04/13

Get out your wallet!  I encourage purchasing here.

  • You should buy a SSD.  Not necessarily news to you, but that article does a good job of summarizing why.
  • On the other hand, SSD prices are already on their way up/availability is way down.  Japan’s disasters are having a ripple effect through the high-tech supply chain.  Either buy immediately or get ready to wait for a while…
  • Introduction to Architecting Systems for Scale – you either don’t care, or find scaling questions immediately engaging.  I am one of the latter, so here’s the link.
  • I’ve been watching for a little while.  One thing I’ve discovered: there’s a lot of updates going on!  Another thing that’s nice to see: DragonFlyupdates, including ones that help with our move to gcc 4.4.
  • Aw, no more Kermit.  (via)  Not that I have a use for it at this point, but still: aww.  I bet in about 10 years I’ll say the same thing about… gopher?  Remember that?  It’s not even supported in Firefox 4 now, which kinda makes me feel sad.  And old.
  • Server plans: Facebook vs. Google.  (warning: Facebook article is somewhat giddy.)
  • The infinite hard drive.  (via I lost it, sorry)

Here’s an extra little thing: next time you’re dealing with dusty computer equipment, remember this picture:

That is what happens to an exposed RJ45 port after a few years in a salt mine (my employer).  This was inside an enclosed, mostly-sealed  structure, too.

Posted by     Categories: DragonFly, Lazy Reading, pkgsrc     1 Comment

Next release April 23rd

Branch tomorrow, release in 2 weeks.  There’s a ton of new features for 2.10, so this will be a fun release.  I’m trying to get pkgsrc-2011Q1 packages built for 2.10 ahead of time, too.

Posted by     Categories: DragonFly, Goings-on, pkgsrc     3 Comments

pkgsrc-2011Q1 details

I already noted that the quarterly release is out, but the pkgsrc-2011Q1 release announcement is available now.  There’s good reasons to link to it – the list of updated packages, new packages, and credits for the work people have been doing.  Here’s the part I really want to pick out:

We’re aiming to make this the last branch to support non-DESTDIR packages. We have almost finished the transition to DESTDIR installation, where a staging directory is used to make a binary package, which is then managed by the pkg_install tools.

The reason I’m highlighting this is: it’s good news!  One of the long-term complaints with pkgsrc is that the upgrade process is painful.  If you try to build an upgrade and the build processfails after uninstalling the existing package, not only are you not getting the upgrade, but you’ve lost the existing package.  Binary packages for download helps with this (and generally is faster), but only so many packages can be built separately and made available for download.

Building a package separately and then installing from there removes these issues.  No binary redistribution issues, actual downtime is minimal, and the package is known to work when an upgrade happens.  This removes most of the problems I’ve heard raised about pkgsrc over the years.

Posted by     Categories: DragonFly, pkgsrc     0 Comments

pkgsrc-2011Q1 tagged

It’s tagged, though there’s no release announcement yet.  Working on building binaries starting tonight…

Posted by     Categories: DragonFly, pkgsrc     0 Comments