SConstruct revision 11294
1955SN/A# -*- mode:python -*-
2955SN/A
31762SN/A# Copyright (c) 2013, 2015 ARM Limited
4955SN/A# All rights reserved.
5955SN/A#
6955SN/A# The license below extends only to copyright in the software and shall
7955SN/A# not be construed as granting a license to any other intellectual
8955SN/A# property including but not limited to intellectual property relating
9955SN/A# to a hardware implementation of the functionality of the software
10955SN/A# licensed hereunder.  You may use the software subject to the license
11955SN/A# terms below provided that you ensure that this notice is replicated
12955SN/A# unmodified and in its entirety in all distributions of the software,
13955SN/A# modified or unmodified, in source code or in binary form.
14955SN/A#
15955SN/A# Copyright (c) 2011 Advanced Micro Devices, Inc.
16955SN/A# Copyright (c) 2009 The Hewlett-Packard Development Company
17955SN/A# Copyright (c) 2004-2005 The Regents of The University of Michigan
18955SN/A# All rights reserved.
19955SN/A#
20955SN/A# Redistribution and use in source and binary forms, with or without
21955SN/A# modification, are permitted provided that the following conditions are
22955SN/A# met: redistributions of source code must retain the above copyright
23955SN/A# notice, this list of conditions and the following disclaimer;
24955SN/A# redistributions in binary form must reproduce the above copyright
25955SN/A# notice, this list of conditions and the following disclaimer in the
26955SN/A# documentation and/or other materials provided with the distribution;
27955SN/A# neither the name of the copyright holders nor the names of its
282665Ssaidi@eecs.umich.edu# contributors may be used to endorse or promote products derived from
292665Ssaidi@eecs.umich.edu# this software without specific prior written permission.
30955SN/A#
31955SN/A# THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS
32955SN/A# "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT
33955SN/A# LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR
34955SN/A# A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT
352632Sstever@eecs.umich.edu# OWNER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL,
362632Sstever@eecs.umich.edu# SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT
372632Sstever@eecs.umich.edu# LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE,
382632Sstever@eecs.umich.edu# DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY
39955SN/A# THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT
402632Sstever@eecs.umich.edu# (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE
412632Sstever@eecs.umich.edu# OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
422761Sstever@eecs.umich.edu#
432632Sstever@eecs.umich.edu# Authors: Steve Reinhardt
442632Sstever@eecs.umich.edu#          Nathan Binkert
452632Sstever@eecs.umich.edu
462761Sstever@eecs.umich.edu###################################################
472761Sstever@eecs.umich.edu#
482761Sstever@eecs.umich.edu# SCons top-level build description (SConstruct) file.
492632Sstever@eecs.umich.edu#
502632Sstever@eecs.umich.edu# While in this directory ('gem5'), just type 'scons' to build the default
512761Sstever@eecs.umich.edu# configuration (see below), or type 'scons build/<CONFIG>/<binary>'
522761Sstever@eecs.umich.edu# to build some other configuration (e.g., 'build/ALPHA/gem5.opt' for
532761Sstever@eecs.umich.edu# the optimized full-system version).
542761Sstever@eecs.umich.edu#
552761Sstever@eecs.umich.edu# You can build gem5 in a different directory as long as there is a
562632Sstever@eecs.umich.edu# 'build/<CONFIG>' somewhere along the target path.  The build system
572632Sstever@eecs.umich.edu# expects that all configs under the same build directory are being
582632Sstever@eecs.umich.edu# built for the same host system.
592632Sstever@eecs.umich.edu#
602632Sstever@eecs.umich.edu# Examples:
612632Sstever@eecs.umich.edu#
622632Sstever@eecs.umich.edu#   The following two commands are equivalent.  The '-u' option tells
63955SN/A#   scons to search up the directory tree for this SConstruct file.
64955SN/A#   % cd <path-to-src>/gem5 ; scons build/ALPHA/gem5.debug
65955SN/A#   % cd <path-to-src>/gem5/build/ALPHA; scons -u gem5.debug
66955SN/A#
67955SN/A#   The following two commands are equivalent and demonstrate building
685396Ssaidi@eecs.umich.edu#   in a directory outside of the source tree.  The '-C' option tells
694202Sbinkertn@umich.edu#   scons to chdir to the specified directory to find this SConstruct
705342Sstever@gmail.com#   file.
71955SN/A#   % cd <path-to-src>/gem5 ; scons /local/foo/build/ALPHA/gem5.debug
725273Sstever@gmail.com#   % cd /local/foo/build/ALPHA; scons -C <path-to-src>/gem5 gem5.debug
735273Sstever@gmail.com#
742656Sstever@eecs.umich.edu# You can use 'scons -H' to print scons options.  If you're in this
752656Sstever@eecs.umich.edu# 'gem5' directory (or use -u or -C to tell scons where to find this
762656Sstever@eecs.umich.edu# file), you can use 'scons -h' to print all the gem5-specific build
772656Sstever@eecs.umich.edu# options as well.
782656Sstever@eecs.umich.edu#
792656Sstever@eecs.umich.edu###################################################
802656Sstever@eecs.umich.edu
812653Sstever@eecs.umich.edu# Check for recent-enough Python and SCons versions.
825227Ssaidi@eecs.umich.edutry:
835227Ssaidi@eecs.umich.edu    # Really old versions of scons only take two options for the
845227Ssaidi@eecs.umich.edu    # function, so check once without the revision and once with the
855227Ssaidi@eecs.umich.edu    # revision, the first instance will fail for stuff other than
865396Ssaidi@eecs.umich.edu    # 0.98, and the second will fail for 0.98.0
875396Ssaidi@eecs.umich.edu    EnsureSConsVersion(0, 98)
885396Ssaidi@eecs.umich.edu    EnsureSConsVersion(0, 98, 1)
895396Ssaidi@eecs.umich.eduexcept SystemExit, e:
905396Ssaidi@eecs.umich.edu    print """
915396Ssaidi@eecs.umich.eduFor more details, see:
925396Ssaidi@eecs.umich.edu    http://gem5.org/Dependencies
935396Ssaidi@eecs.umich.edu"""
945396Ssaidi@eecs.umich.edu    raise
955396Ssaidi@eecs.umich.edu
965396Ssaidi@eecs.umich.edu# We ensure the python version early because because python-config
975396Ssaidi@eecs.umich.edu# requires python 2.5
985396Ssaidi@eecs.umich.edutry:
995396Ssaidi@eecs.umich.edu    EnsurePythonVersion(2, 5)
1005396Ssaidi@eecs.umich.eduexcept SystemExit, e:
1015396Ssaidi@eecs.umich.edu    print """
1025396Ssaidi@eecs.umich.eduYou can use a non-default installation of the Python interpreter by
1035396Ssaidi@eecs.umich.edurearranging your PATH so that scons finds the non-default 'python' and
1045396Ssaidi@eecs.umich.edu'python-config' first.
1055396Ssaidi@eecs.umich.edu
1065396Ssaidi@eecs.umich.eduFor more details, see:
1075396Ssaidi@eecs.umich.edu    http://gem5.org/wiki/index.php/Using_a_non-default_Python_installation
1085396Ssaidi@eecs.umich.edu"""
1095396Ssaidi@eecs.umich.edu    raise
1105396Ssaidi@eecs.umich.edu
1115396Ssaidi@eecs.umich.edu# Global Python includes
1125396Ssaidi@eecs.umich.eduimport itertools
1135396Ssaidi@eecs.umich.eduimport os
1145396Ssaidi@eecs.umich.eduimport re
1155396Ssaidi@eecs.umich.eduimport subprocess
1165396Ssaidi@eecs.umich.eduimport sys
1175396Ssaidi@eecs.umich.edu
1185396Ssaidi@eecs.umich.edufrom os import mkdir, environ
1195396Ssaidi@eecs.umich.edufrom os.path import abspath, basename, dirname, expanduser, normpath
1205396Ssaidi@eecs.umich.edufrom os.path import exists,  isdir, isfile
1215396Ssaidi@eecs.umich.edufrom os.path import join as joinpath, split as splitpath
1225396Ssaidi@eecs.umich.edu
1235396Ssaidi@eecs.umich.edu# SCons includes
1245396Ssaidi@eecs.umich.eduimport SCons
1255396Ssaidi@eecs.umich.eduimport SCons.Node
1265396Ssaidi@eecs.umich.edu
1275396Ssaidi@eecs.umich.eduextra_python_paths = [
1285396Ssaidi@eecs.umich.edu    Dir('src/python').srcnode().abspath, # gem5 includes
1295396Ssaidi@eecs.umich.edu    Dir('ext/ply').srcnode().abspath, # ply is used by several files
1305396Ssaidi@eecs.umich.edu    ]
1315396Ssaidi@eecs.umich.edu
1325396Ssaidi@eecs.umich.edusys.path[1:1] = extra_python_paths
1335396Ssaidi@eecs.umich.edu
1345396Ssaidi@eecs.umich.edufrom m5.util import compareVersions, readCommand
1355396Ssaidi@eecs.umich.edufrom m5.util.terminal import get_termcap
1365396Ssaidi@eecs.umich.edu
1375396Ssaidi@eecs.umich.eduhelp_texts = {
1385396Ssaidi@eecs.umich.edu    "options" : "",
1395396Ssaidi@eecs.umich.edu    "global_vars" : "",
1405396Ssaidi@eecs.umich.edu    "local_vars" : ""
1415396Ssaidi@eecs.umich.edu}
1425396Ssaidi@eecs.umich.edu
1435396Ssaidi@eecs.umich.eduExport("help_texts")
1445396Ssaidi@eecs.umich.edu
1455396Ssaidi@eecs.umich.edu
1465396Ssaidi@eecs.umich.edu# There's a bug in scons in that (1) by default, the help texts from
1475396Ssaidi@eecs.umich.edu# AddOption() are supposed to be displayed when you type 'scons -h'
1485396Ssaidi@eecs.umich.edu# and (2) you can override the help displayed by 'scons -h' using the
1495396Ssaidi@eecs.umich.edu# Help() function, but these two features are incompatible: once
1504781Snate@binkert.org# you've overridden the help text using Help(), there's no way to get
1511852SN/A# at the help texts from AddOptions.  See:
152955SN/A#     http://scons.tigris.org/issues/show_bug.cgi?id=2356
153955SN/A#     http://scons.tigris.org/issues/show_bug.cgi?id=2611
154955SN/A# This hack lets us extract the help text from AddOptions and
1553717Sstever@eecs.umich.edu# re-inject it via Help().  Ideally someday this bug will be fixed and
1563716Sstever@eecs.umich.edu# we can just use AddOption directly.
157955SN/Adef AddLocalOption(*args, **kwargs):
1581533SN/A    col_width = 30
1593716Sstever@eecs.umich.edu
1601533SN/A    help = "  " + ", ".join(args)
1614678Snate@binkert.org    if "help" in kwargs:
1624678Snate@binkert.org        length = len(help)
1634678Snate@binkert.org        if length >= col_width:
1644678Snate@binkert.org            help += "\n" + " " * col_width
1654678Snate@binkert.org        else:
1664678Snate@binkert.org            help += " " * (col_width - length)
1674678Snate@binkert.org        help += kwargs["help"]
1684678Snate@binkert.org    help_texts["options"] += help + "\n"
1694678Snate@binkert.org
1704678Snate@binkert.org    AddOption(*args, **kwargs)
1714678Snate@binkert.org
1724678Snate@binkert.orgAddLocalOption('--colors', dest='use_colors', action='store_true',
1734678Snate@binkert.org               help="Add color to abbreviated scons output")
1744678Snate@binkert.orgAddLocalOption('--no-colors', dest='use_colors', action='store_false',
1754678Snate@binkert.org               help="Don't add color to abbreviated scons output")
1764678Snate@binkert.orgAddLocalOption('--with-cxx-config', dest='with_cxx_config',
1774678Snate@binkert.org               action='store_true',
1784678Snate@binkert.org               help="Build with support for C++-based configuration")
1794678Snate@binkert.orgAddLocalOption('--default', dest='default', type='string', action='store',
1804678Snate@binkert.org               help='Override which build_opts file to use for defaults')
1814678Snate@binkert.orgAddLocalOption('--ignore-style', dest='ignore_style', action='store_true',
1824973Ssaidi@eecs.umich.edu               help='Disable style checking hooks')
1834678Snate@binkert.orgAddLocalOption('--no-lto', dest='no_lto', action='store_true',
1844678Snate@binkert.org               help='Disable Link-Time Optimization for fast')
1854678Snate@binkert.orgAddLocalOption('--update-ref', dest='update_ref', action='store_true',
1864678Snate@binkert.org               help='Update test reference outputs')
1874678Snate@binkert.orgAddLocalOption('--verbose', dest='verbose', action='store_true',
1884678Snate@binkert.org               help='Print full tool command lines')
189955SN/AAddLocalOption('--without-python', dest='without_python',
190955SN/A               action='store_true',
1912632Sstever@eecs.umich.edu               help='Build without Python configuration support')
1922632Sstever@eecs.umich.eduAddLocalOption('--without-tcmalloc', dest='without_tcmalloc',
193955SN/A               action='store_true',
194955SN/A               help='Disable linking against tcmalloc')
195955SN/AAddLocalOption('--with-ubsan', dest='with_ubsan', action='store_true',
196955SN/A               help='Build with Undefined Behavior Sanitizer if available')
1972632Sstever@eecs.umich.edu
198955SN/Atermcap = get_termcap(GetOption('use_colors'))
1992632Sstever@eecs.umich.edu
2002632Sstever@eecs.umich.edu########################################################################
2012632Sstever@eecs.umich.edu#
2022632Sstever@eecs.umich.edu# Set up the main build environment.
2032632Sstever@eecs.umich.edu#
2042632Sstever@eecs.umich.edu########################################################################
2052632Sstever@eecs.umich.edu
2062632Sstever@eecs.umich.edu# export TERM so that clang reports errors in color
2072632Sstever@eecs.umich.eduuse_vars = set([ 'AS', 'AR', 'CC', 'CXX', 'HOME', 'LD_LIBRARY_PATH',
2082632Sstever@eecs.umich.edu                 'LIBRARY_PATH', 'PATH', 'PKG_CONFIG_PATH', 'PROTOC',
2092632Sstever@eecs.umich.edu                 'PYTHONPATH', 'RANLIB', 'SWIG', 'TERM' ])
2102632Sstever@eecs.umich.edu
2112632Sstever@eecs.umich.eduuse_prefixes = [
2123718Sstever@eecs.umich.edu    "CCACHE_",         # ccache (caching compiler wrapper) configuration
2133718Sstever@eecs.umich.edu    "CCC_",            # clang static analyzer configuration
2143718Sstever@eecs.umich.edu    "DISTCC_",         # distcc (distributed compiler wrapper) configuration
2153718Sstever@eecs.umich.edu    "INCLUDE_SERVER_", # distcc pump server settings
2163718Sstever@eecs.umich.edu    "M5",              # M5 configuration (e.g., path to kernels)
2173718Sstever@eecs.umich.edu    ]
2183718Sstever@eecs.umich.edu
2193718Sstever@eecs.umich.eduuse_env = {}
2203718Sstever@eecs.umich.edufor key,val in sorted(os.environ.iteritems()):
2213718Sstever@eecs.umich.edu    if key in use_vars or \
2223718Sstever@eecs.umich.edu            any([key.startswith(prefix) for prefix in use_prefixes]):
2233718Sstever@eecs.umich.edu        use_env[key] = val
2243718Sstever@eecs.umich.edu
2252634Sstever@eecs.umich.edu# Tell scons to avoid implicit command dependencies to avoid issues
2262634Sstever@eecs.umich.edu# with the param wrappes being compiled twice (see
2272632Sstever@eecs.umich.edu# http://scons.tigris.org/issues/show_bug.cgi?id=2811)
2282638Sstever@eecs.umich.edumain = Environment(ENV=use_env, IMPLICIT_COMMAND_DEPENDENCIES=0)
2292632Sstever@eecs.umich.edumain.Decider('MD5-timestamp')
2302632Sstever@eecs.umich.edumain.root = Dir(".")         # The current directory (where this file lives).
2312632Sstever@eecs.umich.edumain.srcdir = Dir("src")     # The source directory
2322632Sstever@eecs.umich.edu
2332632Sstever@eecs.umich.edumain_dict_keys = main.Dictionary().keys()
2342632Sstever@eecs.umich.edu
2351858SN/A# Check that we have a C/C++ compiler
2363716Sstever@eecs.umich.eduif not ('CC' in main_dict_keys and 'CXX' in main_dict_keys):
2372638Sstever@eecs.umich.edu    print "No C++ compiler installed (package g++ on Ubuntu and RedHat)"
2382638Sstever@eecs.umich.edu    Exit(1)
2392638Sstever@eecs.umich.edu
2402638Sstever@eecs.umich.edu# Check that swig is present
2412638Sstever@eecs.umich.eduif not 'SWIG' in main_dict_keys:
2422638Sstever@eecs.umich.edu    print "swig is not installed (package swig on Ubuntu and RedHat)"
2432638Sstever@eecs.umich.edu    Exit(1)
2443716Sstever@eecs.umich.edu
2452634Sstever@eecs.umich.edu# add useful python code PYTHONPATH so it can be used by subprocesses
2462634Sstever@eecs.umich.edu# as well
247955SN/Amain.AppendENVPath('PYTHONPATH', extra_python_paths)
2485341Sstever@gmail.com
2495341Sstever@gmail.com########################################################################
2505341Sstever@gmail.com#
2515341Sstever@gmail.com# Mercurial Stuff.
252955SN/A#
253955SN/A# If the gem5 directory is a mercurial repository, we should do some
254955SN/A# extra things.
255955SN/A#
256955SN/A########################################################################
257955SN/A
258955SN/Ahgdir = main.root.Dir(".hg")
2591858SN/A
2601858SN/Amercurial_style_message = """
2612632Sstever@eecs.umich.eduYou're missing the gem5 style hook, which automatically checks your code
262955SN/Aagainst the gem5 style rules on hg commit and qrefresh commands.  This
2634494Ssaidi@eecs.umich.eduscript will now install the hook in your .hg/hgrc file.
2644494Ssaidi@eecs.umich.eduPress enter to continue, or ctrl-c to abort: """
2653716Sstever@eecs.umich.edu
2661105SN/Amercurial_style_hook = """
2672667Sstever@eecs.umich.edu# The following lines were automatically added by gem5/SConstruct
2682667Sstever@eecs.umich.edu# to provide the gem5 style-checking hooks
2692667Sstever@eecs.umich.edu[extensions]
2702667Sstever@eecs.umich.edustyle = %s/util/style.py
2712667Sstever@eecs.umich.edu
2722667Sstever@eecs.umich.edu[hooks]
2731869SN/Apretxncommit.style = python:style.check_style
2741869SN/Apre-qrefresh.style = python:style.check_style
2751869SN/A# End of SConstruct additions
2761869SN/A
2771869SN/A""" % (main.root.abspath)
2781065SN/A
2795341Sstever@gmail.commercurial_lib_not_found = """
2805341Sstever@gmail.comMercurial libraries cannot be found, ignoring style hook.  If
2815341Sstever@gmail.comyou are a gem5 developer, please fix this and run the style
2825341Sstever@gmail.comhook. It is important.
2835341Sstever@gmail.com"""
2845341Sstever@gmail.com
2855341Sstever@gmail.com# Check for style hook and prompt for installation if it's not there.
2865341Sstever@gmail.com# Skip this if --ignore-style was specified, there's no .hg dir to
2875341Sstever@gmail.com# install a hook in, or there's no interactive terminal to prompt.
2885341Sstever@gmail.comif not GetOption('ignore_style') and hgdir.exists() and sys.stdin.isatty():
2895341Sstever@gmail.com    style_hook = True
2905341Sstever@gmail.com    try:
2915341Sstever@gmail.com        from mercurial import ui
2925341Sstever@gmail.com        ui = ui.ui()
2935341Sstever@gmail.com        ui.readconfig(hgdir.File('hgrc').abspath)
2945341Sstever@gmail.com        style_hook = ui.config('hooks', 'pretxncommit.style', None) and \
2955341Sstever@gmail.com                     ui.config('hooks', 'pre-qrefresh.style', None)
2965341Sstever@gmail.com    except ImportError:
2975341Sstever@gmail.com        print mercurial_lib_not_found
2985341Sstever@gmail.com
2995341Sstever@gmail.com    if not style_hook:
3005341Sstever@gmail.com        print mercurial_style_message,
3015341Sstever@gmail.com        # continue unless user does ctrl-c/ctrl-d etc.
3025341Sstever@gmail.com        try:
3035341Sstever@gmail.com            raw_input()
3045341Sstever@gmail.com        except:
3055341Sstever@gmail.com            print "Input exception, exiting scons.\n"
3065397Ssaidi@eecs.umich.edu            sys.exit(1)
3075397Ssaidi@eecs.umich.edu        hgrc_path = '%s/.hg/hgrc' % main.root.abspath
3085341Sstever@gmail.com        print "Adding style hook to", hgrc_path, "\n"
3095341Sstever@gmail.com        try:
3105341Sstever@gmail.com            hgrc = open(hgrc_path, 'a')
3115341Sstever@gmail.com            hgrc.write(mercurial_style_hook)
3125341Sstever@gmail.com            hgrc.close()
3135341Sstever@gmail.com        except:
3145341Sstever@gmail.com            print "Error updating", hgrc_path
3155341Sstever@gmail.com            sys.exit(1)
3165341Sstever@gmail.com
3175341Sstever@gmail.com
3185341Sstever@gmail.com###################################################
3195341Sstever@gmail.com#
3205341Sstever@gmail.com# Figure out which configurations to set up based on the path(s) of
3215341Sstever@gmail.com# the target(s).
3225341Sstever@gmail.com#
3235341Sstever@gmail.com###################################################
3245341Sstever@gmail.com
3255341Sstever@gmail.com# Find default configuration & binary.
3265341Sstever@gmail.comDefault(environ.get('M5_DEFAULT_BINARY', 'build/ALPHA/gem5.debug'))
3275341Sstever@gmail.com
3285341Sstever@gmail.com# helper function: find last occurrence of element in list
3295341Sstever@gmail.comdef rfind(l, elt, offs = -1):
3305344Sstever@gmail.com    for i in range(len(l)+offs, 0, -1):
3315341Sstever@gmail.com        if l[i] == elt:
3325341Sstever@gmail.com            return i
3335341Sstever@gmail.com    raise ValueError, "element not found"
3345341Sstever@gmail.com
3355341Sstever@gmail.com# Take a list of paths (or SCons Nodes) and return a list with all
3362632Sstever@eecs.umich.edu# paths made absolute and ~-expanded.  Paths will be interpreted
3375199Sstever@gmail.com# relative to the launch directory unless a different root is provided
3383918Ssaidi@eecs.umich.edudef makePathListAbsolute(path_list, root=GetLaunchDir()):
3393918Ssaidi@eecs.umich.edu    return [abspath(joinpath(root, expanduser(str(p))))
3403940Ssaidi@eecs.umich.edu            for p in path_list]
3414781Snate@binkert.org
3424781Snate@binkert.org# Each target must have 'build' in the interior of the path; the
3433918Ssaidi@eecs.umich.edu# directory below this will determine the build parameters.  For
3444781Snate@binkert.org# example, for target 'foo/bar/build/ALPHA_SE/arch/alpha/blah.do' we
3454781Snate@binkert.org# recognize that ALPHA_SE specifies the configuration because it
3463918Ssaidi@eecs.umich.edu# follow 'build' in the build path.
3474781Snate@binkert.org
3484781Snate@binkert.org# The funky assignment to "[:]" is needed to replace the list contents
3493940Ssaidi@eecs.umich.edu# in place rather than reassign the symbol to a new list, which
3503942Ssaidi@eecs.umich.edu# doesn't work (obviously!).
3513940Ssaidi@eecs.umich.eduBUILD_TARGETS[:] = makePathListAbsolute(BUILD_TARGETS)
3523918Ssaidi@eecs.umich.edu
3533918Ssaidi@eecs.umich.edu# Generate a list of the unique build roots and configs that the
354955SN/A# collected targets reference.
3551858SN/Avariant_paths = []
3563918Ssaidi@eecs.umich.edubuild_root = None
3573918Ssaidi@eecs.umich.edufor t in BUILD_TARGETS:
3583918Ssaidi@eecs.umich.edu    path_dirs = t.split('/')
3593918Ssaidi@eecs.umich.edu    try:
3603940Ssaidi@eecs.umich.edu        build_top = rfind(path_dirs, 'build', -2)
3613940Ssaidi@eecs.umich.edu    except:
3623918Ssaidi@eecs.umich.edu        print "Error: no non-leaf 'build' dir found on target path", t
3633918Ssaidi@eecs.umich.edu        Exit(1)
3643918Ssaidi@eecs.umich.edu    this_build_root = joinpath('/',*path_dirs[:build_top+1])
3653918Ssaidi@eecs.umich.edu    if not build_root:
3663918Ssaidi@eecs.umich.edu        build_root = this_build_root
3673918Ssaidi@eecs.umich.edu    else:
3683918Ssaidi@eecs.umich.edu        if this_build_root != build_root:
3693918Ssaidi@eecs.umich.edu            print "Error: build targets not under same build root\n"\
3703918Ssaidi@eecs.umich.edu                  "  %s\n  %s" % (build_root, this_build_root)
3713940Ssaidi@eecs.umich.edu            Exit(1)
3723918Ssaidi@eecs.umich.edu    variant_path = joinpath('/',*path_dirs[:build_top+2])
3733918Ssaidi@eecs.umich.edu    if variant_path not in variant_paths:
3745397Ssaidi@eecs.umich.edu        variant_paths.append(variant_path)
3755397Ssaidi@eecs.umich.edu
3765397Ssaidi@eecs.umich.edu# Make sure build_root exists (might not if this is the first build there)
3775397Ssaidi@eecs.umich.eduif not isdir(build_root):
3785397Ssaidi@eecs.umich.edu    mkdir(build_root)
3795397Ssaidi@eecs.umich.edumain['BUILDROOT'] = build_root
3801851SN/A
3811851SN/AExport('main')
3821858SN/A
3835200Sstever@gmail.commain.SConsignFile(joinpath(build_root, "sconsign"))
384955SN/A
3853053Sstever@eecs.umich.edu# Default duplicate option is to use hard links, but this messes up
3863053Sstever@eecs.umich.edu# when you use emacs to edit a file in the target dir, as emacs moves
3873053Sstever@eecs.umich.edu# file to file~ then copies to file, breaking the link.  Symbolic
3883053Sstever@eecs.umich.edu# (soft) links work better.
3893053Sstever@eecs.umich.edumain.SetOption('duplicate', 'soft-copy')
3903053Sstever@eecs.umich.edu
3913053Sstever@eecs.umich.edu#
3923053Sstever@eecs.umich.edu# Set up global sticky variables... these are common to an entire build
3933053Sstever@eecs.umich.edu# tree (not specific to a particular build like ALPHA_SE)
3944742Sstever@eecs.umich.edu#
3954742Sstever@eecs.umich.edu
3963053Sstever@eecs.umich.eduglobal_vars_file = joinpath(build_root, 'variables.global')
3973053Sstever@eecs.umich.edu
3983053Sstever@eecs.umich.eduglobal_vars = Variables(global_vars_file, args=ARGUMENTS)
3993053Sstever@eecs.umich.edu
4003053Sstever@eecs.umich.eduglobal_vars.AddVariables(
4013053Sstever@eecs.umich.edu    ('CC', 'C compiler', environ.get('CC', main['CC'])),
4023053Sstever@eecs.umich.edu    ('CXX', 'C++ compiler', environ.get('CXX', main['CXX'])),
4033053Sstever@eecs.umich.edu    ('SWIG', 'SWIG tool', environ.get('SWIG', main['SWIG'])),
4043053Sstever@eecs.umich.edu    ('PROTOC', 'protoc tool', environ.get('PROTOC', 'protoc')),
4052667Sstever@eecs.umich.edu    ('BATCH', 'Use batch pool for build and tests', False),
4064554Sbinkertn@umich.edu    ('BATCH_CMD', 'Batch pool submission command name', 'qdo'),
4074554Sbinkertn@umich.edu    ('M5_BUILD_CACHE', 'Cache built objects in this directory', False),
4082667Sstever@eecs.umich.edu    ('EXTRAS', 'Add extra directories to the compilation', '')
4094554Sbinkertn@umich.edu    )
4104554Sbinkertn@umich.edu
4114554Sbinkertn@umich.edu# Update main environment with values from ARGUMENTS & global_vars_file
4124554Sbinkertn@umich.eduglobal_vars.Update(main)
4134554Sbinkertn@umich.eduhelp_texts["global_vars"] += global_vars.GenerateHelpText(main)
4144554Sbinkertn@umich.edu
4154554Sbinkertn@umich.edu# Save sticky variable settings back to current variables file
4164781Snate@binkert.orgglobal_vars.Save(global_vars_file, main)
4174554Sbinkertn@umich.edu
4184554Sbinkertn@umich.edu# Parse EXTRAS variable to build list of all directories where we're
4192667Sstever@eecs.umich.edu# look for sources etc.  This list is exported as extras_dir_list.
4204554Sbinkertn@umich.edubase_dir = main.srcdir.abspath
4214554Sbinkertn@umich.eduif main['EXTRAS']:
4224554Sbinkertn@umich.edu    extras_dir_list = makePathListAbsolute(main['EXTRAS'].split(':'))
4234554Sbinkertn@umich.eduelse:
4242667Sstever@eecs.umich.edu    extras_dir_list = []
4254554Sbinkertn@umich.edu
4262667Sstever@eecs.umich.eduExport('base_dir')
4274554Sbinkertn@umich.eduExport('extras_dir_list')
4284554Sbinkertn@umich.edu
4292667Sstever@eecs.umich.edu# the ext directory should be on the #includes path
4302638Sstever@eecs.umich.edumain.Append(CPPPATH=[Dir('ext')])
4312638Sstever@eecs.umich.edu
4322638Sstever@eecs.umich.edudef strip_build_path(path, env):
4333716Sstever@eecs.umich.edu    path = str(path)
4343716Sstever@eecs.umich.edu    variant_base = env['BUILDROOT'] + os.path.sep
4351858SN/A    if path.startswith(variant_base):
4365227Ssaidi@eecs.umich.edu        path = path[len(variant_base):]
4375227Ssaidi@eecs.umich.edu    elif path.startswith('build/'):
4385227Ssaidi@eecs.umich.edu        path = path[6:]
4395227Ssaidi@eecs.umich.edu    return path
4405227Ssaidi@eecs.umich.edu
4415227Ssaidi@eecs.umich.edu# Generate a string of the form:
4425227Ssaidi@eecs.umich.edu#   common/path/prefix/src1, src2 -> tgt1, tgt2
4435227Ssaidi@eecs.umich.edu# to print while building.
4445227Ssaidi@eecs.umich.educlass Transform(object):
4455227Ssaidi@eecs.umich.edu    # all specific color settings should be here and nowhere else
4465227Ssaidi@eecs.umich.edu    tool_color = termcap.Normal
4475227Ssaidi@eecs.umich.edu    pfx_color = termcap.Yellow
4485227Ssaidi@eecs.umich.edu    srcs_color = termcap.Yellow + termcap.Bold
4495227Ssaidi@eecs.umich.edu    arrow_color = termcap.Blue + termcap.Bold
4505227Ssaidi@eecs.umich.edu    tgts_color = termcap.Yellow + termcap.Bold
4515204Sstever@gmail.com
4525204Sstever@gmail.com    def __init__(self, tool, max_sources=99):
4535204Sstever@gmail.com        self.format = self.tool_color + (" [%8s] " % tool) \
4545204Sstever@gmail.com                      + self.pfx_color + "%s" \
4555204Sstever@gmail.com                      + self.srcs_color + "%s" \
4565204Sstever@gmail.com                      + self.arrow_color + " -> " \
4575204Sstever@gmail.com                      + self.tgts_color + "%s" \
4585204Sstever@gmail.com                      + termcap.Normal
4595204Sstever@gmail.com        self.max_sources = max_sources
4605204Sstever@gmail.com
4615204Sstever@gmail.com    def __call__(self, target, source, env, for_signature=None):
4625204Sstever@gmail.com        # truncate source list according to max_sources param
4635204Sstever@gmail.com        source = source[0:self.max_sources]
4645204Sstever@gmail.com        def strip(f):
4655204Sstever@gmail.com            return strip_build_path(str(f), env)
4665204Sstever@gmail.com        if len(source) > 0:
4675204Sstever@gmail.com            srcs = map(strip, source)
4685204Sstever@gmail.com        else:
4695204Sstever@gmail.com            srcs = ['']
4703118Sstever@eecs.umich.edu        tgts = map(strip, target)
4713118Sstever@eecs.umich.edu        # surprisingly, os.path.commonprefix is a dumb char-by-char string
4723118Sstever@eecs.umich.edu        # operation that has nothing to do with paths.
4733118Sstever@eecs.umich.edu        com_pfx = os.path.commonprefix(srcs + tgts)
4743118Sstever@eecs.umich.edu        com_pfx_len = len(com_pfx)
4753118Sstever@eecs.umich.edu        if com_pfx:
4763118Sstever@eecs.umich.edu            # do some cleanup and sanity checking on common prefix
4773118Sstever@eecs.umich.edu            if com_pfx[-1] == ".":
4783118Sstever@eecs.umich.edu                # prefix matches all but file extension: ok
4793118Sstever@eecs.umich.edu                # back up one to change 'foo.cc -> o' to 'foo.cc -> .o'
4803118Sstever@eecs.umich.edu                com_pfx = com_pfx[0:-1]
4813716Sstever@eecs.umich.edu            elif com_pfx[-1] == "/":
4823118Sstever@eecs.umich.edu                # common prefix is directory path: OK
4833118Sstever@eecs.umich.edu                pass
4843118Sstever@eecs.umich.edu            else:
4853118Sstever@eecs.umich.edu                src0_len = len(srcs[0])
4863118Sstever@eecs.umich.edu                tgt0_len = len(tgts[0])
4873118Sstever@eecs.umich.edu                if src0_len == com_pfx_len:
4883118Sstever@eecs.umich.edu                    # source is a substring of target, OK
4893118Sstever@eecs.umich.edu                    pass
4903118Sstever@eecs.umich.edu                elif tgt0_len == com_pfx_len:
4913716Sstever@eecs.umich.edu                    # target is a substring of source, need to back up to
4923118Sstever@eecs.umich.edu                    # avoid empty string on RHS of arrow
4933118Sstever@eecs.umich.edu                    sep_idx = com_pfx.rfind(".")
4943118Sstever@eecs.umich.edu                    if sep_idx != -1:
4953118Sstever@eecs.umich.edu                        com_pfx = com_pfx[0:sep_idx]
4963118Sstever@eecs.umich.edu                    else:
4973118Sstever@eecs.umich.edu                        com_pfx = ''
4983118Sstever@eecs.umich.edu                elif src0_len > com_pfx_len and srcs[0][com_pfx_len] == ".":
4993118Sstever@eecs.umich.edu                    # still splitting at file extension: ok
5003118Sstever@eecs.umich.edu                    pass
5013118Sstever@eecs.umich.edu                else:
5023483Ssaidi@eecs.umich.edu                    # probably a fluke; ignore it
5033494Ssaidi@eecs.umich.edu                    com_pfx = ''
5043494Ssaidi@eecs.umich.edu        # recalculate length in case com_pfx was modified
5053483Ssaidi@eecs.umich.edu        com_pfx_len = len(com_pfx)
5063483Ssaidi@eecs.umich.edu        def fmt(files):
5073483Ssaidi@eecs.umich.edu            f = map(lambda s: s[com_pfx_len:], files)
5083053Sstever@eecs.umich.edu            return ', '.join(f)
5093053Sstever@eecs.umich.edu        return self.format % (com_pfx, fmt(srcs), fmt(tgts))
5103918Ssaidi@eecs.umich.edu
5113053Sstever@eecs.umich.eduExport('Transform')
5123053Sstever@eecs.umich.edu
5133053Sstever@eecs.umich.edu# enable the regression script to use the termcap
5143053Sstever@eecs.umich.edumain['TERMCAP'] = termcap
5153053Sstever@eecs.umich.edu
5161858SN/Aif GetOption('verbose'):
5171858SN/A    def MakeAction(action, string, *args, **kwargs):
5181858SN/A        return Action(action, *args, **kwargs)
5191858SN/Aelse:
5201858SN/A    MakeAction = Action
5211858SN/A    main['CCCOMSTR']        = Transform("CC")
5221859SN/A    main['CXXCOMSTR']       = Transform("CXX")
5231858SN/A    main['ASCOMSTR']        = Transform("AS")
5241858SN/A    main['SWIGCOMSTR']      = Transform("SWIG")
5251858SN/A    main['ARCOMSTR']        = Transform("AR", 0)
5261859SN/A    main['LINKCOMSTR']      = Transform("LINK", 0)
5271859SN/A    main['RANLIBCOMSTR']    = Transform("RANLIB", 0)
5281862SN/A    main['M4COMSTR']        = Transform("M4")
5293053Sstever@eecs.umich.edu    main['SHCCCOMSTR']      = Transform("SHCC")
5303053Sstever@eecs.umich.edu    main['SHCXXCOMSTR']     = Transform("SHCXX")
5313053Sstever@eecs.umich.eduExport('MakeAction')
5323053Sstever@eecs.umich.edu
5331859SN/A# Initialize the Link-Time Optimization (LTO) flags
5341859SN/Amain['LTO_CCFLAGS'] = []
5351859SN/Amain['LTO_LDFLAGS'] = []
5361859SN/A
5371859SN/A# According to the readme, tcmalloc works best if the compiler doesn't
5381859SN/A# assume that we're using the builtin malloc and friends. These flags
5391859SN/A# are compiler-specific, so we need to set them after we detect which
5401859SN/A# compiler we're using.
5411862SN/Amain['TCMALLOC_CCFLAGS'] = []
5421859SN/A
5431859SN/ACXX_version = readCommand([main['CXX'],'--version'], exception=False)
5441859SN/ACXX_V = readCommand([main['CXX'],'-V'], exception=False)
5451858SN/A
5461858SN/Amain['GCC'] = CXX_version and CXX_version.find('g++') >= 0
5472139SN/Amain['CLANG'] = CXX_version and CXX_version.find('clang') >= 0
5484202Sbinkertn@umich.eduif main['GCC'] + main['CLANG'] > 1:
5494202Sbinkertn@umich.edu    print 'Error: How can we have two at the same time?'
5502139SN/A    Exit(1)
5512155SN/A
5524202Sbinkertn@umich.edu# Set up default C++ compiler flags
5534202Sbinkertn@umich.eduif main['GCC'] or main['CLANG']:
5544202Sbinkertn@umich.edu    # As gcc and clang share many flags, do the common parts here
5552155SN/A    main.Append(CCFLAGS=['-pipe'])
5561869SN/A    main.Append(CCFLAGS=['-fno-strict-aliasing'])
5571869SN/A    # Enable -Wall and -Wextra and then disable the few warnings that
5581869SN/A    # we consistently violate
5591869SN/A    main.Append(CCFLAGS=['-Wall', '-Wundef', '-Wextra',
5604202Sbinkertn@umich.edu                         '-Wno-sign-compare', '-Wno-unused-parameter'])
5614202Sbinkertn@umich.edu    # We always compile using C++11
5624202Sbinkertn@umich.edu    main.Append(CXXFLAGS=['-std=c++11'])
5634202Sbinkertn@umich.eduelse:
5644202Sbinkertn@umich.edu    print termcap.Yellow + termcap.Bold + 'Error' + termcap.Normal,
5654202Sbinkertn@umich.edu    print "Don't know what compiler options to use for your compiler."
5664202Sbinkertn@umich.edu    print termcap.Yellow + '       compiler:' + termcap.Normal, main['CXX']
5674202Sbinkertn@umich.edu    print termcap.Yellow + '       version:' + termcap.Normal,
5685341Sstever@gmail.com    if not CXX_version:
5695341Sstever@gmail.com        print termcap.Yellow + termcap.Bold + "COMMAND NOT FOUND!" +\
5705341Sstever@gmail.com               termcap.Normal
5715342Sstever@gmail.com    else:
5725342Sstever@gmail.com        print CXX_version.replace('\n', '<nl>')
5734202Sbinkertn@umich.edu    print "       If you're trying to use a compiler other than GCC"
5744202Sbinkertn@umich.edu    print "       or clang, there appears to be something wrong with your"
5754202Sbinkertn@umich.edu    print "       environment."
5764202Sbinkertn@umich.edu    print "       "
5774202Sbinkertn@umich.edu    print "       If you are trying to use a compiler other than those listed"
5781869SN/A    print "       above you will need to ease fix SConstruct and "
5794202Sbinkertn@umich.edu    print "       src/SConscript to support that compiler."
5801869SN/A    Exit(1)
5812508SN/A
5822508SN/Aif main['GCC']:
5832508SN/A    # Check for a supported version of gcc. >= 4.7 is chosen for its
5842508SN/A    # level of c++11 support. See
5854202Sbinkertn@umich.edu    # http://gcc.gnu.org/projects/cxx0x.html for details.
5861869SN/A    gcc_version = readCommand([main['CXX'], '-dumpversion'], exception=False)
5875385Sstever@gmail.com    if compareVersions(gcc_version, "4.7") < 0:
5885385Sstever@gmail.com        print 'Error: gcc version 4.7 or newer required.'
5895385Sstever@gmail.com        print '       Installed version:', gcc_version
5905385Sstever@gmail.com        Exit(1)
5911869SN/A
5921869SN/A    main['GCC_VERSION'] = gcc_version
5931869SN/A
5941869SN/A    # gcc from version 4.8 and above generates "rep; ret" instructions
5951869SN/A    # to avoid performance penalties on certain AMD chips. Older
5961965SN/A    # assemblers detect this as an error, "Error: expecting string
5971965SN/A    # instruction after `rep'"
5981965SN/A    if compareVersions(gcc_version, "4.8") > 0:
5991869SN/A        as_version_raw = readCommand([main['AS'], '-v', '/dev/null'],
6001869SN/A                                     exception=False).split()
6012733Sktlim@umich.edu
6023356Sbinkertn@umich.edu        # version strings may contain extra distro-specific
6033356Sbinkertn@umich.edu        # qualifiers, so play it safe and keep only what comes before
6044773Snate@binkert.org        # the first hyphen
6051869SN/A        as_version = as_version_raw[-1].split('-')[0] if as_version_raw \
6061858SN/A            else None
6071869SN/A
6081869SN/A        if not as_version or compareVersions(as_version, "2.23") < 0:
6091869SN/A            print termcap.Yellow + termcap.Bold + \
6101858SN/A                'Warning: This combination of gcc and binutils have' + \
6112761Sstever@eecs.umich.edu                ' known incompatibilities.\n' + \
6121869SN/A                '         If you encounter build problems, please update ' + \
6135385Sstever@gmail.com                'binutils to 2.23.' + \
6145385Sstever@gmail.com                termcap.Normal
6153584Ssaidi@eecs.umich.edu
6161869SN/A    # Make sure we warn if the user has requested to compile with the
6171869SN/A    # Undefined Benahvior Sanitizer and this version of gcc does not
6181869SN/A    # support it.
6191869SN/A    if GetOption('with_ubsan') and \
6201869SN/A            compareVersions(gcc_version, '4.9') < 0:
6211869SN/A        print termcap.Yellow + termcap.Bold + \
6221858SN/A            'Warning: UBSan is only supported using gcc 4.9 and later.' + \
623955SN/A            termcap.Normal
624955SN/A
6251869SN/A    # Add the appropriate Link-Time Optimization (LTO) flags
6261869SN/A    # unless LTO is explicitly turned off. Note that these flags
6271869SN/A    # are only used by the fast target.
6281869SN/A    if not GetOption('no_lto'):
6291869SN/A        # Pass the LTO flag when compiling to produce GIMPLE
6301869SN/A        # output, we merely create the flags here and only append
6311869SN/A        # them later
6321869SN/A        main['LTO_CCFLAGS'] = ['-flto=%d' % GetOption('num_jobs')]
6331869SN/A
6341869SN/A        # Use the same amount of jobs for LTO as we are running
6351869SN/A        # scons with
6361869SN/A        main['LTO_LDFLAGS'] = ['-flto=%d' % GetOption('num_jobs')]
6371869SN/A
6381869SN/A    main.Append(TCMALLOC_CCFLAGS=['-fno-builtin-malloc', '-fno-builtin-calloc',
6391869SN/A                                  '-fno-builtin-realloc', '-fno-builtin-free'])
6401869SN/A
6411869SN/Aelif main['CLANG']:
6421869SN/A    # Check for a supported version of clang, >= 3.1 is needed to
6431869SN/A    # support similar features as gcc 4.7. See
6441869SN/A    # http://clang.llvm.org/cxx_status.html for details
6451869SN/A    clang_version_re = re.compile(".* version (\d+\.\d+)")
6461869SN/A    clang_version_match = clang_version_re.search(CXX_version)
6471869SN/A    if (clang_version_match):
6481869SN/A        clang_version = clang_version_match.groups()[0]
6491869SN/A        if compareVersions(clang_version, "3.1") < 0:
6501869SN/A            print 'Error: clang version 3.1 or newer required.'
6511869SN/A            print '       Installed version:', clang_version
6521869SN/A            Exit(1)
6531869SN/A    else:
6543716Sstever@eecs.umich.edu        print 'Error: Unable to determine clang version.'
6553356Sbinkertn@umich.edu        Exit(1)
6563356Sbinkertn@umich.edu
6573356Sbinkertn@umich.edu    # clang has a few additional warnings that we disable, extraneous
6583356Sbinkertn@umich.edu    # parantheses are allowed due to Ruby's printing of the AST,
6593356Sbinkertn@umich.edu    # finally self assignments are allowed as the generated CPU code
6603356Sbinkertn@umich.edu    # is relying on this
6614781Snate@binkert.org    main.Append(CCFLAGS=['-Wno-parentheses',
6621869SN/A                         '-Wno-self-assign',
6631869SN/A                         # Some versions of libstdc++ (4.8?) seem to
6641869SN/A                         # use struct hash and class hash
6651869SN/A                         # interchangeably.
6661869SN/A                         '-Wno-mismatched-tags',
6671869SN/A                         ])
6681869SN/A
6692655Sstever@eecs.umich.edu    main.Append(TCMALLOC_CCFLAGS=['-fno-builtin'])
6702655Sstever@eecs.umich.edu
6712655Sstever@eecs.umich.edu    # On Mac OS X/Darwin we need to also use libc++ (part of XCode) as
6722655Sstever@eecs.umich.edu    # opposed to libstdc++, as the later is dated.
6732655Sstever@eecs.umich.edu    if sys.platform == "darwin":
6742655Sstever@eecs.umich.edu        main.Append(CXXFLAGS=['-stdlib=libc++'])
6752655Sstever@eecs.umich.edu        main.Append(LIBS=['c++'])
6762655Sstever@eecs.umich.edu
6772655Sstever@eecs.umich.eduelse:
6782655Sstever@eecs.umich.edu    print termcap.Yellow + termcap.Bold + 'Error' + termcap.Normal,
6792655Sstever@eecs.umich.edu    print "Don't know what compiler options to use for your compiler."
6802655Sstever@eecs.umich.edu    print termcap.Yellow + '       compiler:' + termcap.Normal, main['CXX']
6812655Sstever@eecs.umich.edu    print termcap.Yellow + '       version:' + termcap.Normal,
6822655Sstever@eecs.umich.edu    if not CXX_version:
6832655Sstever@eecs.umich.edu        print termcap.Yellow + termcap.Bold + "COMMAND NOT FOUND!" +\
6842655Sstever@eecs.umich.edu               termcap.Normal
6852655Sstever@eecs.umich.edu    else:
6862655Sstever@eecs.umich.edu        print CXX_version.replace('\n', '<nl>')
6872655Sstever@eecs.umich.edu    print "       If you're trying to use a compiler other than GCC"
6882655Sstever@eecs.umich.edu    print "       or clang, there appears to be something wrong with your"
6892655Sstever@eecs.umich.edu    print "       environment."
6902655Sstever@eecs.umich.edu    print "       "
6912655Sstever@eecs.umich.edu    print "       If you are trying to use a compiler other than those listed"
6922655Sstever@eecs.umich.edu    print "       above you will need to ease fix SConstruct and "
6932655Sstever@eecs.umich.edu    print "       src/SConscript to support that compiler."
6942655Sstever@eecs.umich.edu    Exit(1)
6952638Sstever@eecs.umich.edu
6962638Sstever@eecs.umich.edu# Set up common yacc/bison flags (needed for Ruby)
6973716Sstever@eecs.umich.edumain['YACCFLAGS'] = '-d'
6982638Sstever@eecs.umich.edumain['YACCHXXFILESUFFIX'] = '.hh'
6992638Sstever@eecs.umich.edu
7001869SN/A# Do this after we save setting back, or else we'll tack on an
7011869SN/A# extra 'qdo' every time we run scons.
7023546Sgblack@eecs.umich.eduif main['BATCH']:
7033546Sgblack@eecs.umich.edu    main['CC']     = main['BATCH_CMD'] + ' ' + main['CC']
7043546Sgblack@eecs.umich.edu    main['CXX']    = main['BATCH_CMD'] + ' ' + main['CXX']
7053546Sgblack@eecs.umich.edu    main['AS']     = main['BATCH_CMD'] + ' ' + main['AS']
7064202Sbinkertn@umich.edu    main['AR']     = main['BATCH_CMD'] + ' ' + main['AR']
7073546Sgblack@eecs.umich.edu    main['RANLIB'] = main['BATCH_CMD'] + ' ' + main['RANLIB']
7083546Sgblack@eecs.umich.edu
7093546Sgblack@eecs.umich.eduif sys.platform == 'cygwin':
7103546Sgblack@eecs.umich.edu    # cygwin has some header file issues...
7113546Sgblack@eecs.umich.edu    main.Append(CCFLAGS=["-Wno-uninitialized"])
7124781Snate@binkert.org
7134781Snate@binkert.org# Check for the protobuf compiler
7144781Snate@binkert.orgprotoc_version = readCommand([main['PROTOC'], '--version'],
7154781Snate@binkert.org                             exception='').split()
7164781Snate@binkert.org
7174781Snate@binkert.org# First two words should be "libprotoc x.y.z"
7184781Snate@binkert.orgif len(protoc_version) < 2 or protoc_version[0] != 'libprotoc':
7194781Snate@binkert.org    print termcap.Yellow + termcap.Bold + \
7204781Snate@binkert.org        'Warning: Protocol buffer compiler (protoc) not found.\n' + \
7214781Snate@binkert.org        '         Please install protobuf-compiler for tracing support.' + \
7224781Snate@binkert.org        termcap.Normal
7234781Snate@binkert.org    main['PROTOC'] = False
7243546Sgblack@eecs.umich.eduelse:
7253546Sgblack@eecs.umich.edu    # Based on the availability of the compress stream wrappers,
7263546Sgblack@eecs.umich.edu    # require 2.1.0
7274781Snate@binkert.org    min_protoc_version = '2.1.0'
7283546Sgblack@eecs.umich.edu    if compareVersions(protoc_version[1], min_protoc_version) < 0:
7293546Sgblack@eecs.umich.edu        print termcap.Yellow + termcap.Bold + \
7303546Sgblack@eecs.umich.edu            'Warning: protoc version', min_protoc_version, \
7313546Sgblack@eecs.umich.edu            'or newer required.\n' + \
7323546Sgblack@eecs.umich.edu            '         Installed version:', protoc_version[1], \
7333546Sgblack@eecs.umich.edu            termcap.Normal
7343546Sgblack@eecs.umich.edu        main['PROTOC'] = False
7353546Sgblack@eecs.umich.edu    else:
7363546Sgblack@eecs.umich.edu        # Attempt to determine the appropriate include path and
7373546Sgblack@eecs.umich.edu        # library path using pkg-config, that means we also need to
7384202Sbinkertn@umich.edu        # check for pkg-config. Note that it is possible to use
7393546Sgblack@eecs.umich.edu        # protobuf without the involvement of pkg-config. Later on we
7403546Sgblack@eecs.umich.edu        # check go a library config check and at that point the test
7413546Sgblack@eecs.umich.edu        # will fail if libprotobuf cannot be found.
742955SN/A        if readCommand(['pkg-config', '--version'], exception=''):
743955SN/A            try:
744955SN/A                # Attempt to establish what linking flags to add for protobuf
745955SN/A                # using pkg-config
7461858SN/A                main.ParseConfig('pkg-config --cflags --libs-only-L protobuf')
7471858SN/A            except:
7481858SN/A                print termcap.Yellow + termcap.Bold + \
7492632Sstever@eecs.umich.edu                    'Warning: pkg-config could not get protobuf flags.' + \
7502632Sstever@eecs.umich.edu                    termcap.Normal
7515343Sstever@gmail.com
7525343Sstever@gmail.com# Check for SWIG
7535343Sstever@gmail.comif not main.has_key('SWIG'):
7544773Snate@binkert.org    print 'Error: SWIG utility not found.'
7554773Snate@binkert.org    print '       Please install (see http://www.swig.org) and retry.'
7562632Sstever@eecs.umich.edu    Exit(1)
7572632Sstever@eecs.umich.edu
7582632Sstever@eecs.umich.edu# Check for appropriate SWIG version
7592023SN/Aswig_version = readCommand([main['SWIG'], '-version'], exception='').split()
7602632Sstever@eecs.umich.edu# First 3 words should be "SWIG Version x.y.z"
7612632Sstever@eecs.umich.eduif len(swig_version) < 3 or \
7622632Sstever@eecs.umich.edu        swig_version[0] != 'SWIG' or swig_version[1] != 'Version':
7632632Sstever@eecs.umich.edu    print 'Error determining SWIG version.'
7642632Sstever@eecs.umich.edu    Exit(1)
7653716Sstever@eecs.umich.edu
7665342Sstever@gmail.commin_swig_version = '2.0.4'
7672632Sstever@eecs.umich.eduif compareVersions(swig_version[2], min_swig_version) < 0:
7682632Sstever@eecs.umich.edu    print 'Error: SWIG version', min_swig_version, 'or newer required.'
7692632Sstever@eecs.umich.edu    print '       Installed version:', swig_version[2]
7702632Sstever@eecs.umich.edu    Exit(1)
7712023SN/A
7722632Sstever@eecs.umich.edu# Check for known incompatibilities. The standard library shipped with
7732632Sstever@eecs.umich.edu# gcc >= 4.9 does not play well with swig versions prior to 3.0
7745342Sstever@gmail.comif main['GCC'] and compareVersions(gcc_version, '4.9') >= 0 and \
7751889SN/A        compareVersions(swig_version[2], '3.0') < 0:
7762632Sstever@eecs.umich.edu    print termcap.Yellow + termcap.Bold + \
7772632Sstever@eecs.umich.edu        'Warning: This combination of gcc and swig have' + \
7782632Sstever@eecs.umich.edu        ' known incompatibilities.\n' + \
7792632Sstever@eecs.umich.edu        '         If you encounter build problems, please update ' + \
7803716Sstever@eecs.umich.edu        'swig to 3.0 or later.' + \
7813716Sstever@eecs.umich.edu        termcap.Normal
7825342Sstever@gmail.com
7832632Sstever@eecs.umich.edu# Set up SWIG flags & scanner
7842632Sstever@eecs.umich.eduswig_flags=Split('-c++ -python -modern -templatereduce $_CPPINCFLAGS')
7852632Sstever@eecs.umich.edumain.Append(SWIGFLAGS=swig_flags)
7862632Sstever@eecs.umich.edu
7872632Sstever@eecs.umich.edu# Check for 'timeout' from GNU coreutils. If present, regressions will
7882632Sstever@eecs.umich.edu# be run with a time limit. We require version 8.13 since we rely on
7892632Sstever@eecs.umich.edu# support for the '--foreground' option.
7901888SN/Atimeout_lines = readCommand(['timeout', '--version'],
7911888SN/A                            exception='').splitlines()
7921869SN/A# Get the first line and tokenize it
7931869SN/Atimeout_version = timeout_lines[0].split() if timeout_lines else []
7941858SN/Amain['TIMEOUT'] =  timeout_version and \
7955341Sstever@gmail.com    compareVersions(timeout_version[-1], '8.13') >= 0
7962598SN/A
7972598SN/A# filter out all existing swig scanners, they mess up the dependency
7982598SN/A# stuff for some reason
7992598SN/Ascanners = []
8001858SN/Afor scanner in main['SCANNERS']:
8011858SN/A    skeys = scanner.skeys
8021858SN/A    if skeys == '.i':
8031858SN/A        continue
8041858SN/A
8051858SN/A    if isinstance(skeys, (list, tuple)) and '.i' in skeys:
8061858SN/A        continue
8071858SN/A
8081858SN/A    scanners.append(scanner)
8091871SN/A
8101858SN/A# add the new swig scanner that we like better
8111858SN/Afrom SCons.Scanner import ClassicCPP as CPPScanner
8121858SN/Aswig_inc_re = '^[ \t]*[%,#][ \t]*(?:include|import)[ \t]*(<|")([^>"]+)(>|")'
8131858SN/Ascanners.append(CPPScanner("SwigScan", [ ".i" ], "CPPPATH", swig_inc_re))
8141858SN/A
8151858SN/A# replace the scanners list that has what we want
8161858SN/Amain['SCANNERS'] = scanners
8171858SN/A
8181858SN/A# Add a custom Check function to test for structure members.
8191858SN/Adef CheckMember(context, include, decl, member, include_quotes="<>"):
8201858SN/A    context.Message("Checking for member %s in %s..." %
8211859SN/A                    (member, decl))
8221859SN/A    text = """
8231869SN/A#include %(header)s
8241888SN/Aint main(){
8252632Sstever@eecs.umich.edu  %(decl)s test;
8261869SN/A  (void)test.%(member)s;
8271965SN/A  return 0;
8281965SN/A};
8291965SN/A""" % { "header" : include_quotes[0] + include + include_quotes[1],
8302761Sstever@eecs.umich.edu        "decl" : decl,
8311869SN/A        "member" : member,
8321869SN/A        }
8332632Sstever@eecs.umich.edu
8342667Sstever@eecs.umich.edu    ret = context.TryCompile(text, extension=".cc")
8351869SN/A    context.Result(ret)
8361869SN/A    return ret
8372929Sktlim@umich.edu
8382929Sktlim@umich.edu# Platform-specific configuration.  Note again that we assume that all
8393716Sstever@eecs.umich.edu# builds under a given build root run on the same host platform.
8402929Sktlim@umich.educonf = Configure(main,
841955SN/A                 conf_dir = joinpath(build_root, '.scons_config'),
8422598SN/A                 log_file = joinpath(build_root, 'scons_config.log'),
8432598SN/A                 custom_tests = {
8443546Sgblack@eecs.umich.edu        'CheckMember' : CheckMember,
845955SN/A        })
846955SN/A
847955SN/A# Check if we should compile a 64 bit binary on Mac OS X/Darwin
8481530SN/Atry:
849955SN/A    import platform
850955SN/A    uname = platform.uname()
851955SN/A    if uname[0] == 'Darwin' and compareVersions(uname[2], '9.0.0') >= 0:
852        if int(readCommand('sysctl -n hw.cpu64bit_capable')[0]):
853            main.Append(CCFLAGS=['-arch', 'x86_64'])
854            main.Append(CFLAGS=['-arch', 'x86_64'])
855            main.Append(LINKFLAGS=['-arch', 'x86_64'])
856            main.Append(ASFLAGS=['-arch', 'x86_64'])
857except:
858    pass
859
860# Recent versions of scons substitute a "Null" object for Configure()
861# when configuration isn't necessary, e.g., if the "--help" option is
862# present.  Unfortuantely this Null object always returns false,
863# breaking all our configuration checks.  We replace it with our own
864# more optimistic null object that returns True instead.
865if not conf:
866    def NullCheck(*args, **kwargs):
867        return True
868
869    class NullConf:
870        def __init__(self, env):
871            self.env = env
872        def Finish(self):
873            return self.env
874        def __getattr__(self, mname):
875            return NullCheck
876
877    conf = NullConf(main)
878
879# Cache build files in the supplied directory.
880if main['M5_BUILD_CACHE']:
881    print 'Using build cache located at', main['M5_BUILD_CACHE']
882    CacheDir(main['M5_BUILD_CACHE'])
883
884if not GetOption('without_python'):
885    # Find Python include and library directories for embedding the
886    # interpreter. We rely on python-config to resolve the appropriate
887    # includes and linker flags. ParseConfig does not seem to understand
888    # the more exotic linker flags such as -Xlinker and -export-dynamic so
889    # we add them explicitly below. If you want to link in an alternate
890    # version of python, see above for instructions on how to invoke
891    # scons with the appropriate PATH set.
892    #
893    # First we check if python2-config exists, else we use python-config
894    python_config = readCommand(['which', 'python2-config'],
895                                exception='').strip()
896    if not os.path.exists(python_config):
897        python_config = readCommand(['which', 'python-config'],
898                                    exception='').strip()
899    py_includes = readCommand([python_config, '--includes'],
900                              exception='').split()
901    # Strip the -I from the include folders before adding them to the
902    # CPPPATH
903    main.Append(CPPPATH=map(lambda inc: inc[2:], py_includes))
904
905    # Read the linker flags and split them into libraries and other link
906    # flags. The libraries are added later through the call the CheckLib.
907    py_ld_flags = readCommand([python_config, '--ldflags'],
908        exception='').split()
909    py_libs = []
910    for lib in py_ld_flags:
911         if not lib.startswith('-l'):
912             main.Append(LINKFLAGS=[lib])
913         else:
914             lib = lib[2:]
915             if lib not in py_libs:
916                 py_libs.append(lib)
917
918    # verify that this stuff works
919    if not conf.CheckHeader('Python.h', '<>'):
920        print "Error: can't find Python.h header in", py_includes
921        print "Install Python headers (package python-dev on Ubuntu and RedHat)"
922        Exit(1)
923
924    for lib in py_libs:
925        if not conf.CheckLib(lib):
926            print "Error: can't find library %s required by python" % lib
927            Exit(1)
928
929# On Solaris you need to use libsocket for socket ops
930if not conf.CheckLibWithHeader(None, 'sys/socket.h', 'C++', 'accept(0,0,0);'):
931   if not conf.CheckLibWithHeader('socket', 'sys/socket.h', 'C++', 'accept(0,0,0);'):
932       print "Can't find library with socket calls (e.g. accept())"
933       Exit(1)
934
935# Check for zlib.  If the check passes, libz will be automatically
936# added to the LIBS environment variable.
937if not conf.CheckLibWithHeader('z', 'zlib.h', 'C++','zlibVersion();'):
938    print 'Error: did not find needed zlib compression library '\
939          'and/or zlib.h header file.'
940    print '       Please install zlib and try again.'
941    Exit(1)
942
943# If we have the protobuf compiler, also make sure we have the
944# development libraries. If the check passes, libprotobuf will be
945# automatically added to the LIBS environment variable. After
946# this, we can use the HAVE_PROTOBUF flag to determine if we have
947# got both protoc and libprotobuf available.
948main['HAVE_PROTOBUF'] = main['PROTOC'] and \
949    conf.CheckLibWithHeader('protobuf', 'google/protobuf/message.h',
950                            'C++', 'GOOGLE_PROTOBUF_VERIFY_VERSION;')
951
952# If we have the compiler but not the library, print another warning.
953if main['PROTOC'] and not main['HAVE_PROTOBUF']:
954    print termcap.Yellow + termcap.Bold + \
955        'Warning: did not find protocol buffer library and/or headers.\n' + \
956    '       Please install libprotobuf-dev for tracing support.' + \
957    termcap.Normal
958
959# Check for librt.
960have_posix_clock = \
961    conf.CheckLibWithHeader(None, 'time.h', 'C',
962                            'clock_nanosleep(0,0,NULL,NULL);') or \
963    conf.CheckLibWithHeader('rt', 'time.h', 'C',
964                            'clock_nanosleep(0,0,NULL,NULL);')
965
966have_posix_timers = \
967    conf.CheckLibWithHeader([None, 'rt'], [ 'time.h', 'signal.h' ], 'C',
968                            'timer_create(CLOCK_MONOTONIC, NULL, NULL);')
969
970if not GetOption('without_tcmalloc'):
971    if conf.CheckLib('tcmalloc'):
972        main.Append(CCFLAGS=main['TCMALLOC_CCFLAGS'])
973    elif conf.CheckLib('tcmalloc_minimal'):
974        main.Append(CCFLAGS=main['TCMALLOC_CCFLAGS'])
975    else:
976        print termcap.Yellow + termcap.Bold + \
977              "You can get a 12% performance improvement by "\
978              "installing tcmalloc (libgoogle-perftools-dev package "\
979              "on Ubuntu or RedHat)." + termcap.Normal
980
981
982# Detect back trace implementations. The last implementation in the
983# list will be used by default.
984backtrace_impls = [ "none" ]
985
986if conf.CheckLibWithHeader(None, 'execinfo.h', 'C',
987                           'backtrace_symbols_fd((void*)0, 0, 0);'):
988    backtrace_impls.append("glibc")
989
990if backtrace_impls[-1] == "none":
991    default_backtrace_impl = "none"
992    print termcap.Yellow + termcap.Bold + \
993        "No suitable back trace implementation found." + \
994        termcap.Normal
995
996if not have_posix_clock:
997    print "Can't find library for POSIX clocks."
998
999# Check for <fenv.h> (C99 FP environment control)
1000have_fenv = conf.CheckHeader('fenv.h', '<>')
1001if not have_fenv:
1002    print "Warning: Header file <fenv.h> not found."
1003    print "         This host has no IEEE FP rounding mode control."
1004
1005# Check if we should enable KVM-based hardware virtualization. The API
1006# we rely on exists since version 2.6.36 of the kernel, but somehow
1007# the KVM_API_VERSION does not reflect the change. We test for one of
1008# the types as a fall back.
1009have_kvm = conf.CheckHeader('linux/kvm.h', '<>')
1010if not have_kvm:
1011    print "Info: Compatible header file <linux/kvm.h> not found, " \
1012        "disabling KVM support."
1013
1014# x86 needs support for xsave. We test for the structure here since we
1015# won't be able to run new tests by the time we know which ISA we're
1016# targeting.
1017have_kvm_xsave = conf.CheckTypeSize('struct kvm_xsave',
1018                                    '#include <linux/kvm.h>') != 0
1019
1020# Check if the requested target ISA is compatible with the host
1021def is_isa_kvm_compatible(isa):
1022    try:
1023        import platform
1024        host_isa = platform.machine()
1025    except:
1026        print "Warning: Failed to determine host ISA."
1027        return False
1028
1029    if not have_posix_timers:
1030        print "Warning: Can not enable KVM, host seems to lack support " \
1031            "for POSIX timers"
1032        return False
1033
1034    if isa == "arm":
1035        return host_isa in ( "armv7l", "aarch64" )
1036    elif isa == "x86":
1037        if host_isa != "x86_64":
1038            return False
1039
1040        if not have_kvm_xsave:
1041            print "KVM on x86 requires xsave support in kernel headers."
1042            return False
1043
1044        return True
1045    else:
1046        return False
1047
1048
1049# Check if the exclude_host attribute is available. We want this to
1050# get accurate instruction counts in KVM.
1051main['HAVE_PERF_ATTR_EXCLUDE_HOST'] = conf.CheckMember(
1052    'linux/perf_event.h', 'struct perf_event_attr', 'exclude_host')
1053
1054
1055######################################################################
1056#
1057# Finish the configuration
1058#
1059main = conf.Finish()
1060
1061######################################################################
1062#
1063# Collect all non-global variables
1064#
1065
1066# Define the universe of supported ISAs
1067all_isa_list = [ ]
1068Export('all_isa_list')
1069
1070class CpuModel(object):
1071    '''The CpuModel class encapsulates everything the ISA parser needs to
1072    know about a particular CPU model.'''
1073
1074    # Dict of available CPU model objects.  Accessible as CpuModel.dict.
1075    dict = {}
1076
1077    # Constructor.  Automatically adds models to CpuModel.dict.
1078    def __init__(self, name, default=False):
1079        self.name = name           # name of model
1080
1081        # This cpu is enabled by default
1082        self.default = default
1083
1084        # Add self to dict
1085        if name in CpuModel.dict:
1086            raise AttributeError, "CpuModel '%s' already registered" % name
1087        CpuModel.dict[name] = self
1088
1089Export('CpuModel')
1090
1091# Sticky variables get saved in the variables file so they persist from
1092# one invocation to the next (unless overridden, in which case the new
1093# value becomes sticky).
1094sticky_vars = Variables(args=ARGUMENTS)
1095Export('sticky_vars')
1096
1097# Sticky variables that should be exported
1098export_vars = []
1099Export('export_vars')
1100
1101# For Ruby
1102all_protocols = []
1103Export('all_protocols')
1104protocol_dirs = []
1105Export('protocol_dirs')
1106slicc_includes = []
1107Export('slicc_includes')
1108
1109# Walk the tree and execute all SConsopts scripts that wil add to the
1110# above variables
1111if GetOption('verbose'):
1112    print "Reading SConsopts"
1113for bdir in [ base_dir ] + extras_dir_list:
1114    if not isdir(bdir):
1115        print "Error: directory '%s' does not exist" % bdir
1116        Exit(1)
1117    for root, dirs, files in os.walk(bdir):
1118        if 'SConsopts' in files:
1119            if GetOption('verbose'):
1120                print "Reading", joinpath(root, 'SConsopts')
1121            SConscript(joinpath(root, 'SConsopts'))
1122
1123all_isa_list.sort()
1124
1125sticky_vars.AddVariables(
1126    EnumVariable('TARGET_ISA', 'Target ISA', 'alpha', all_isa_list),
1127    ListVariable('CPU_MODELS', 'CPU models',
1128                 sorted(n for n,m in CpuModel.dict.iteritems() if m.default),
1129                 sorted(CpuModel.dict.keys())),
1130    BoolVariable('EFENCE', 'Link with Electric Fence malloc debugger',
1131                 False),
1132    BoolVariable('SS_COMPATIBLE_FP',
1133                 'Make floating-point results compatible with SimpleScalar',
1134                 False),
1135    BoolVariable('USE_SSE2',
1136                 'Compile for SSE2 (-msse2) to get IEEE FP on x86 hosts',
1137                 False),
1138    BoolVariable('USE_POSIX_CLOCK', 'Use POSIX Clocks', have_posix_clock),
1139    BoolVariable('USE_FENV', 'Use <fenv.h> IEEE mode control', have_fenv),
1140    BoolVariable('CP_ANNOTATE', 'Enable critical path annotation capability', False),
1141    BoolVariable('USE_KVM', 'Enable hardware virtualized (KVM) CPU models', have_kvm),
1142    EnumVariable('PROTOCOL', 'Coherence protocol for Ruby', 'None',
1143                  all_protocols),
1144    EnumVariable('BACKTRACE_IMPL', 'Post-mortem dump implementation',
1145                 backtrace_impls[-1], backtrace_impls)
1146    )
1147
1148# These variables get exported to #defines in config/*.hh (see src/SConscript).
1149export_vars += ['USE_FENV', 'SS_COMPATIBLE_FP', 'TARGET_ISA', 'CP_ANNOTATE',
1150                'USE_POSIX_CLOCK', 'USE_KVM', 'PROTOCOL', 'HAVE_PROTOBUF',
1151                'HAVE_PERF_ATTR_EXCLUDE_HOST']
1152
1153###################################################
1154#
1155# Define a SCons builder for configuration flag headers.
1156#
1157###################################################
1158
1159# This function generates a config header file that #defines the
1160# variable symbol to the current variable setting (0 or 1).  The source
1161# operands are the name of the variable and a Value node containing the
1162# value of the variable.
1163def build_config_file(target, source, env):
1164    (variable, value) = [s.get_contents() for s in source]
1165    f = file(str(target[0]), 'w')
1166    print >> f, '#define', variable, value
1167    f.close()
1168    return None
1169
1170# Combine the two functions into a scons Action object.
1171config_action = MakeAction(build_config_file, Transform("CONFIG H", 2))
1172
1173# The emitter munges the source & target node lists to reflect what
1174# we're really doing.
1175def config_emitter(target, source, env):
1176    # extract variable name from Builder arg
1177    variable = str(target[0])
1178    # True target is config header file
1179    target = joinpath('config', variable.lower() + '.hh')
1180    val = env[variable]
1181    if isinstance(val, bool):
1182        # Force value to 0/1
1183        val = int(val)
1184    elif isinstance(val, str):
1185        val = '"' + val + '"'
1186
1187    # Sources are variable name & value (packaged in SCons Value nodes)
1188    return ([target], [Value(variable), Value(val)])
1189
1190config_builder = Builder(emitter = config_emitter, action = config_action)
1191
1192main.Append(BUILDERS = { 'ConfigFile' : config_builder })
1193
1194# libelf build is shared across all configs in the build root.
1195main.SConscript('ext/libelf/SConscript',
1196                variant_dir = joinpath(build_root, 'libelf'))
1197
1198# iostream3 build is shared across all configs in the build root.
1199main.SConscript('ext/iostream3/SConscript',
1200                variant_dir = joinpath(build_root, 'iostream3'))
1201
1202# libfdt build is shared across all configs in the build root.
1203main.SConscript('ext/libfdt/SConscript',
1204                variant_dir = joinpath(build_root, 'libfdt'))
1205
1206# fputils build is shared across all configs in the build root.
1207main.SConscript('ext/fputils/SConscript',
1208                variant_dir = joinpath(build_root, 'fputils'))
1209
1210# DRAMSim2 build is shared across all configs in the build root.
1211main.SConscript('ext/dramsim2/SConscript',
1212                variant_dir = joinpath(build_root, 'dramsim2'))
1213
1214# DRAMPower build is shared across all configs in the build root.
1215main.SConscript('ext/drampower/SConscript',
1216                variant_dir = joinpath(build_root, 'drampower'))
1217
1218# nomali build is shared across all configs in the build root.
1219main.SConscript('ext/nomali/SConscript',
1220                variant_dir = joinpath(build_root, 'nomali'))
1221
1222###################################################
1223#
1224# This function is used to set up a directory with switching headers
1225#
1226###################################################
1227
1228main['ALL_ISA_LIST'] = all_isa_list
1229all_isa_deps = {}
1230def make_switching_dir(dname, switch_headers, env):
1231    # Generate the header.  target[0] is the full path of the output
1232    # header to generate.  'source' is a dummy variable, since we get the
1233    # list of ISAs from env['ALL_ISA_LIST'].
1234    def gen_switch_hdr(target, source, env):
1235        fname = str(target[0])
1236        isa = env['TARGET_ISA'].lower()
1237        try:
1238            f = open(fname, 'w')
1239            print >>f, '#include "%s/%s/%s"' % (dname, isa, basename(fname))
1240            f.close()
1241        except IOError:
1242            print "Failed to create %s" % fname
1243            raise
1244
1245    # Build SCons Action object. 'varlist' specifies env vars that this
1246    # action depends on; when env['ALL_ISA_LIST'] changes these actions
1247    # should get re-executed.
1248    switch_hdr_action = MakeAction(gen_switch_hdr,
1249                          Transform("GENERATE"), varlist=['ALL_ISA_LIST'])
1250
1251    # Instantiate actions for each header
1252    for hdr in switch_headers:
1253        env.Command(hdr, [], switch_hdr_action)
1254
1255    isa_target = Dir('.').up().name.lower().replace('_', '-')
1256    env['PHONY_BASE'] = '#'+isa_target
1257    all_isa_deps[isa_target] = None
1258
1259Export('make_switching_dir')
1260
1261# all-isas -> all-deps -> all-environs -> all_targets
1262main.Alias('#all-isas', [])
1263main.Alias('#all-deps', '#all-isas')
1264
1265# Dummy target to ensure all environments are created before telling
1266# SCons what to actually make (the command line arguments).  We attach
1267# them to the dependence graph after the environments are complete.
1268ORIG_BUILD_TARGETS = list(BUILD_TARGETS) # force a copy; gets closure to work.
1269def environsComplete(target, source, env):
1270    for t in ORIG_BUILD_TARGETS:
1271        main.Depends('#all-targets', t)
1272
1273# Each build/* switching_dir attaches its *-environs target to #all-environs.
1274main.Append(BUILDERS = {'CompleteEnvirons' :
1275                        Builder(action=MakeAction(environsComplete, None))})
1276main.CompleteEnvirons('#all-environs', [])
1277
1278def doNothing(**ignored): pass
1279main.Append(BUILDERS = {'Dummy': Builder(action=MakeAction(doNothing, None))})
1280
1281# The final target to which all the original targets ultimately get attached.
1282main.Dummy('#all-targets', '#all-environs')
1283BUILD_TARGETS[:] = ['#all-targets']
1284
1285###################################################
1286#
1287# Define build environments for selected configurations.
1288#
1289###################################################
1290
1291for variant_path in variant_paths:
1292    if not GetOption('silent'):
1293        print "Building in", variant_path
1294
1295    # Make a copy of the build-root environment to use for this config.
1296    env = main.Clone()
1297    env['BUILDDIR'] = variant_path
1298
1299    # variant_dir is the tail component of build path, and is used to
1300    # determine the build parameters (e.g., 'ALPHA_SE')
1301    (build_root, variant_dir) = splitpath(variant_path)
1302
1303    # Set env variables according to the build directory config.
1304    sticky_vars.files = []
1305    # Variables for $BUILD_ROOT/$VARIANT_DIR are stored in
1306    # $BUILD_ROOT/variables/$VARIANT_DIR so you can nuke
1307    # $BUILD_ROOT/$VARIANT_DIR without losing your variables settings.
1308    current_vars_file = joinpath(build_root, 'variables', variant_dir)
1309    if isfile(current_vars_file):
1310        sticky_vars.files.append(current_vars_file)
1311        if not GetOption('silent'):
1312            print "Using saved variables file %s" % current_vars_file
1313    else:
1314        # Build dir-specific variables file doesn't exist.
1315
1316        # Make sure the directory is there so we can create it later
1317        opt_dir = dirname(current_vars_file)
1318        if not isdir(opt_dir):
1319            mkdir(opt_dir)
1320
1321        # Get default build variables from source tree.  Variables are
1322        # normally determined by name of $VARIANT_DIR, but can be
1323        # overridden by '--default=' arg on command line.
1324        default = GetOption('default')
1325        opts_dir = joinpath(main.root.abspath, 'build_opts')
1326        if default:
1327            default_vars_files = [joinpath(build_root, 'variables', default),
1328                                  joinpath(opts_dir, default)]
1329        else:
1330            default_vars_files = [joinpath(opts_dir, variant_dir)]
1331        existing_files = filter(isfile, default_vars_files)
1332        if existing_files:
1333            default_vars_file = existing_files[0]
1334            sticky_vars.files.append(default_vars_file)
1335            print "Variables file %s not found,\n  using defaults in %s" \
1336                  % (current_vars_file, default_vars_file)
1337        else:
1338            print "Error: cannot find variables file %s or " \
1339                  "default file(s) %s" \
1340                  % (current_vars_file, ' or '.join(default_vars_files))
1341            Exit(1)
1342
1343    # Apply current variable settings to env
1344    sticky_vars.Update(env)
1345
1346    help_texts["local_vars"] += \
1347        "Build variables for %s:\n" % variant_dir \
1348                 + sticky_vars.GenerateHelpText(env)
1349
1350    # Process variable settings.
1351
1352    if not have_fenv and env['USE_FENV']:
1353        print "Warning: <fenv.h> not available; " \
1354              "forcing USE_FENV to False in", variant_dir + "."
1355        env['USE_FENV'] = False
1356
1357    if not env['USE_FENV']:
1358        print "Warning: No IEEE FP rounding mode control in", variant_dir + "."
1359        print "         FP results may deviate slightly from other platforms."
1360
1361    if env['EFENCE']:
1362        env.Append(LIBS=['efence'])
1363
1364    if env['USE_KVM']:
1365        if not have_kvm:
1366            print "Warning: Can not enable KVM, host seems to lack KVM support"
1367            env['USE_KVM'] = False
1368        elif not is_isa_kvm_compatible(env['TARGET_ISA']):
1369            print "Info: KVM support disabled due to unsupported host and " \
1370                "target ISA combination"
1371            env['USE_KVM'] = False
1372
1373    # Warn about missing optional functionality
1374    if env['USE_KVM']:
1375        if not main['HAVE_PERF_ATTR_EXCLUDE_HOST']:
1376            print "Warning: perf_event headers lack support for the " \
1377                "exclude_host attribute. KVM instruction counts will " \
1378                "be inaccurate."
1379
1380    # Save sticky variable settings back to current variables file
1381    sticky_vars.Save(current_vars_file, env)
1382
1383    if env['USE_SSE2']:
1384        env.Append(CCFLAGS=['-msse2'])
1385
1386    # The src/SConscript file sets up the build rules in 'env' according
1387    # to the configured variables.  It returns a list of environments,
1388    # one for each variant build (debug, opt, etc.)
1389    SConscript('src/SConscript', variant_dir = variant_path, exports = 'env')
1390
1391def pairwise(iterable):
1392    "s -> (s0,s1), (s1,s2), (s2, s3), ..."
1393    a, b = itertools.tee(iterable)
1394    b.next()
1395    return itertools.izip(a, b)
1396
1397# Create false dependencies so SCons will parse ISAs, establish
1398# dependencies, and setup the build Environments serially. Either
1399# SCons (likely) and/or our SConscripts (possibly) cannot cope with -j
1400# greater than 1. It appears to be standard race condition stuff; it
1401# doesn't always fail, but usually, and the behaviors are different.
1402# Every time I tried to remove this, builds would fail in some
1403# creative new way. So, don't do that. You'll want to, though, because
1404# tests/SConscript takes a long time to make its Environments.
1405for t1, t2 in pairwise(sorted(all_isa_deps.iterkeys())):
1406    main.Depends('#%s-deps'     % t2, '#%s-deps'     % t1)
1407    main.Depends('#%s-environs' % t2, '#%s-environs' % t1)
1408
1409# base help text
1410Help('''
1411Usage: scons [scons options] [build variables] [target(s)]
1412
1413Extra scons options:
1414%(options)s
1415
1416Global build variables:
1417%(global_vars)s
1418
1419%(local_vars)s
1420''' % help_texts)
1421